Jun 19 23:45:29 devstack cinder-volume[82315]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 23:45:29 devstack cinder-volume[82315]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 23:45:29 devstack cinder-volume[82315]: we strongly recommend against using it for new projects. Jun 19 23:45:29 devstack cinder-volume[82315]: If you are already using Eventlet, we recommend migrating to a different Jun 19 23:45:29 devstack cinder-volume[82315]: framework. For more detail see Jun 19 23:45:29 devstack cinder-volume[82315]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 23:45:29 devstack cinder-volume[82315]: import eventlet # noqa Jun 19 23:45:32 devstack cinder-volume[82315]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 23:45:32 devstack cinder-volume[82315]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 23:45:32 devstack cinder-volume[82315]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 23:45:33 devstack cinder-volume[82315]: INFO dbcounter [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Registered counter for database cinder Jun 19 23:45:33 devstack cinder-volume[82315]: DEBUG oslo_db.sqlalchemy.engines [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:45:33 devstack cinder-volume[82315]: DEBUG dbcounter [-] [82315] Writer thread running {{(pid=82315) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 23:45:33 devstack cinder-volume[82315]: INFO cinder.rpc [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 23:45:33 devstack cinder-volume[82315]: INFO cinder.rpc [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 23:45:33 devstack cinder-volume[82315]: DEBUG oslo_db.sqlalchemy.engines [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:45:33 devstack cinder-volume[82315]: INFO cinder.volume.manager [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Determined volume DB was empty at startup. Jun 19 23:45:33 devstack cinder-volume[82315]: DEBUG cinder.volume.manager [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82315) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 23:45:33 devstack cinder-volume[82315]: INFO cinder.volume.manager [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 19 23:45:33 devstack cinder-volume[82315]: WARNING stevedore.named [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 23:45:33 devstack cinder-volume[82315]: WARNING castellan.key_manager [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 23:45:33 devstack cinder-volume[82315]: WARNING cinder.keymgr.conf_key_mgr [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 23:45:33 devstack cinder-volume[82315]: DEBUG cinder.volume.drivers.lvm [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82315) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 19 23:45:33 devstack cinder-volume[82315]: DEBUG oslo_concurrency.processutils [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82315) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_concurrency.processutils [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.579s {{(pid=82315) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_db.sqlalchemy.engines [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:45:34 devstack cinder-volume[82315]: INFO cinder.rpc [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 19 23:45:34 devstack cinder-volume[82315]: INFO cinder.rpc [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 19 23:45:34 devstack cinder-volume[82315]: WARNING stevedore.named [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 23:45:34 devstack cinder-volume[82315]: WARNING castellan.key_manager [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 23:45:34 devstack cinder-volume[82315]: INFO cinder.volume.manager [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_db.sqlalchemy.engines [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82315) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:45:34 devstack cinder-volume[82315]: INFO oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Starting 1 workers Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Started child 82488 {{(pid=82315) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Full set of CONF: {{(pid=82315) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] ******************************************************************************** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Configuration options gathered from: {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] ================================================================================ {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 23:45:34 devstack cinder-volume[82488]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] allow_availability_zone_fallback = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] allow_compression_on_image_upload = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] allowed_direct_url_schemes = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] api_rate_limit = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] auth_strategy = keystone {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] az_cache_duration = 3600 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_availability_zone = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_host = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_stats_polling_interval = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backup_api_class = cinder.backup.api.API {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backup_name_template = backup-%s {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backup_use_same_host = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backup_use_temp_snapshot = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] chap_password = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] chap_username = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_internal_tenant_project_id = a4538a10c8cb481882520ce0510ed78d {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_internal_tenant_user_id = 261325e6e81044c9aad0d60305f7f3fa {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cloned_volume_same_az = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cluster = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] compression_format = gzip {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] compute_api_class = cinder.compute.nova.API {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] config_dir = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] config_source = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] control_exchange = openstack {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] debug = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] default_availability_zone = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] default_group_type = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] default_volume_type = lvmdriver-1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] disk_geometry = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] driver_client_cert = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] driver_client_cert_key = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] driver_data_namespace = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] driver_ssl_cert_path = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] driver_ssl_cert_verify = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] driver_use_ssl = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] enable_force_upload = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] enable_new_services = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] enable_unsupported_driver = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] enforce_multipath_for_image_xfer = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] filter_function = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_api_insecure = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_api_ssl_compression = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_ca_certificates_file = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_catalog_info = image:glance:publicURL {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_certfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_keyfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_num_retries = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance_request_timeout = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] goodness_function = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] graceful_shutdown_timeout = 5 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] group_api_class = cinder.group.api.API {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] host = devstack {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_compress_on_upload = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_conversion_address_space_limit = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_conversion_cpu_limit = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_conversion_disable = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_upload_use_cinder_backend = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_upload_use_internal_tenant = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_volume_cache_enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_volume_cache_max_count = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] image_volume_cache_max_size_gb = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] init_host_max_objects_retrieval = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] instance_format = [instance: %(uuid)s] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] iscsi_target_flags = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] iscsi_write_cache = on {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] iser_helper = tgtadm {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] iser_ip_address = 192.168.122.215 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] iser_port = 3260 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_color = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_config_append = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_dir = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_file = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_options = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_rotate_interval = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_rotate_interval_type = days {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] log_rotation_type = none {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] max_age = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] max_logfile_count = 30 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] max_logfile_size_mb = 200 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] max_over_subscription_ratio = 20.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] message_reap_interval = 86400 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] message_ttl = 2592000 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] migration_create_volume_timeout_secs = 300 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] monkey_patch = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] monkey_patch_modules = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] my_ip = 192.168.122.215 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] no_snapshot_gb_quota = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] num_iser_scan_tries = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] num_shell_tries = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] num_volume_device_scan_tries = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] nvmeof_conn_info_version = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] nvmet_ns_id = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] nvmet_port_id = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] osapi_max_limit = 1000 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] osapi_volume_ext_list = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] osapi_volume_listen_port = 8776 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] osapi_volume_use_ssl = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] osapi_volume_workers = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] per_volume_size_limit = -1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] periodic_fuzzy_delay = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82488]: INFO cinder.volume.manager [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] periodic_interval = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] public_endpoint = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] publish_errors = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] quota_backup_gigabytes = 1000 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] quota_backups = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] quota_gigabytes = 1000 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] quota_groups = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] quota_snapshots = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] quota_volumes = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] rate_limit_burst = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] rate_limit_except_level = CRITICAL {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] rate_limit_interval = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] reinit_driver_count = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] replication_device = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] report_discard_supported = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] report_interval = 120 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] reservation_clean_interval = 86400 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] reservation_expire = 86400 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] reserved_image_namespaces = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] reserved_percentage = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] rpc_response_timeout = 120 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] run_external_periodic_tasks = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] scst_target_driver = iscsi {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] scst_target_iqn_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_down_time = 720 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] shell_completion = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] snapshot_name_template = snapshot-%s {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] snapshot_same_host = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] split_loggers = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] state_path = /opt/stack/data/cinder {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] storage_availability_zone = nova {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] storage_protocol = iSCSI {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] syslog_log_facility = LOG_USER {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] target_helper = lioadm {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] target_ip_address = 192.168.122.215 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] target_port = 3260 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] target_protocol = iscsi {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] target_secondary_ip_addresses = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] trace_flags = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] transport_url = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] until_refresh = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] use_chap_auth = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] use_default_quota_class = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] use_journal = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] use_json = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] use_multipath_for_image_xfer = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] use_stderr = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] use_syslog = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] verify_glance_signatures = enabled {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_api_class = cinder.volume.api.API {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_backend_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_clear = zero {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_clear_ionice = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_clear_size = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_copy_bps_limit = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_dd_blocksize = 1M {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_name_template = volume-%s {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_service_inithost_offload = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volume_usage_audit_period = month {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] zoning_mode = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_concurrency.disable_process_locking = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.auth_section = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.auth_type = password {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.auth_version = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.cache = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.certfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.include_service_catalog = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.insecure = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.interface = public {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.keyfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_password = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcache_username = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.region_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.service_type = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.backend = dogpile.cache.null {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.backend_argument = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.backend_expiration_time = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.config_prefix = cache.oslo {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.debug_cache_backend = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.enable_retry_client = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.enable_socket_keepalive = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.expiration_time = 600 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.hashclient_retry_attempts = 2 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.memcache_dead_retry = 300 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.memcache_pool_maxsize = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.memcache_sasl_enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.password = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.proxies = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.redis_db = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.redis_server = localhost:6379 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.retry_attempts = 2 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.retry_delay = 0.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.socket_keepalive_count = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.socket_keepalive_idle = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.socket_keepalive_interval = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.socket_timeout = 1.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.tls_allowed_ciphers = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.tls_cafile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.tls_certfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.tls_enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.tls_keyfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cache.username = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] coordination.backend_url = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.asyncio_connection = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.asyncio_slave_connection = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.backend = sqlalchemy {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.connection = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.connection_debug = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.connection_parameters = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.connection_recycle_time = 3600 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.connection_trace = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.db_inc_retry_interval = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.db_max_retries = 20 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.db_max_retry_interval = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.db_retry_interval = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.max_overflow = 50 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.max_pool_size = 5 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.max_retries = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.mysql_wsrep_sync_wait = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.pool_timeout = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.retry_interval = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.slave_connection = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.sqlite_synchronous = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.synchronous_reader = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] database.use_db_reconnect = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.connection_string = messaging:// {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.es_doc_type = notification {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.es_scroll_size = 10000 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.es_scroll_time = 2m {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.filter_error_trace = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.hmac_keys = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.sentinel_service_name = mymaster {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.socket_timeout = 0.1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.trace_requests = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler.trace_sqlalchemy = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler_jaeger.process_tags = {} {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler_jaeger.service_name_prefix = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] profiler_otlp.service_name_prefix = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.enforce_new_defaults = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: WARNING oslo_config.cfg [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.enforce_scope = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.policy_default_rule = default {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.policy_file = policy.yaml {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack sudo[82493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] privsep_osbrick.group = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] privsep_osbrick.helper_command = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] privsep_osbrick.user = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_sys_admin.group = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_sys_admin.helper_command = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] cinder_sys_admin.user = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.auth_section = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.auth_type = password {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.cafile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.certfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.collect_timing = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack sudo[82493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:34 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.insecure = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.keyfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.send_service_user_token = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.split_loggers = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] service_user.timeout = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.auth_section = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.auth_type = password {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.certfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.collect_timing = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.insecure = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.keyfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.region_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.split_loggers = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] glance.timeout = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.backend_availability_zone = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.chap_password = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.chap_username = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.disk_geometry = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.driver_client_cert = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.driver_client_cert_key = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.driver_data_namespace = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.driver_use_ssl = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.extra_capabilities = {} {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.filter_function = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.goodness_function = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.iscsi_target_flags = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.iscsi_write_cache = on {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.iser_helper = tgtadm {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.iser_port = 3260 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.lvm_share_target = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.lvm_type = auto {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.num_shell_tries = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.replication_device = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.report_discard_supported = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.reserved_percentage = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.target_helper = tgtadm {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.target_port = 3260 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.target_protocol = iscsi {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.trace_flags = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.unique_fqdn_network = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.use_chap_auth = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_backend_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_clear = zero {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_clear_ionice = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_clear_size = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_reports.file_event_handler = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_reports.log_dir = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.backend_host = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.chap_password = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.chap_username = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.disk_geometry = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.driver_client_cert = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.extra_capabilities = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.filter_function = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.goodness_function = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.iser_helper = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.iser_ip_address = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.iser_port = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.lvm_share_target = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.lvm_type = auto {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.num_shell_tries = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.replication_device = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.report_discard_supported = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.reserved_percentage = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.scst_target_driver = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.storage_protocol = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.target_helper = lioadm {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.target_ip_address = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.target_port = 3260 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.trace_flags = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.use_chap_auth = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_clear = zero {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_clear_size = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] lvmdriver-1.volumes_dir = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.ssl = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_notifications.driver = [] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_notifications.retry = -1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] key_manager.fixed_key = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.barbican_api_version = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.barbican_endpoint = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.barbican_endpoint_type = public {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.barbican_region_name = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.cafile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.certfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.collect_timing = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.insecure = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.keyfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.number_of_retries = 60 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.retry_delay = 1 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.send_service_user_token = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.split_loggers = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.timeout = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.verify_ssl = True {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican.verify_ssl_path = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.auth_section = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.auth_type = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.cafile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.certfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.collect_timing = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.insecure = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.keyfile = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.split_loggers = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] barbican_service_user.timeout = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.approle_role_id = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.approle_secret_id = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.kv_mountpoint = secret {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.kv_path = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.kv_version = 2 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.namespace = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.root_token_id = **** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.ssl_ca_crt_file = None {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.timeout = 60.0 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.use_ssl = False {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:45:34 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] ******************************************************************************** {{(pid=82315) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 23:45:35 devstack sudo[82493]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:35 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:35 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:35 devstack sudo[82530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:35 devstack sudo[82530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:36 devstack sudo[82530]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:36 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.676s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:36 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 23:45:36 devstack cinder-volume[82488]: INFO cinder.brick.local_dev.lvm [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 19 23:45:36 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:36 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:36 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:36 devstack sudo[82797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:45:36 devstack sudo[82797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:36 devstack sudo[82797]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:36 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:36 devstack cinder-volume[82488]: DEBUG cinder.brick.local_dev.lvm [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82488) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 19 23:45:36 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:36 devstack sudo[82985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:36 devstack sudo[82985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:38 devstack sudo[82985]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:38 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.356s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:38 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:38 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:38 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:38 devstack sudo[83239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:38 devstack sudo[83239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:38 devstack sudo[83239]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:38 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.678s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:38 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:38 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:38 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:38 devstack sudo[83275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 19 23:45:38 devstack sudo[83275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:39 devstack sudo[83275]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:39 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.675s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:39 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:39 devstack sudo[83279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:45:39 devstack sudo[83279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:40 devstack sudo[83279]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:40 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:40 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:40 devstack sudo[83290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:45:40 devstack sudo[83290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:41 devstack sudo[83290]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:41 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.885s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:41 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:41 devstack sudo[83294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:45:41 devstack sudo[83294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:42 devstack sudo[83294]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:42 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.921s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:42 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:42 devstack sudo[83301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:42 devstack sudo[83301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:42 devstack sudo[83301]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:42 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.681s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:42 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:42 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:42 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:42 devstack sudo[83309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:42 devstack sudo[83309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:43 devstack sudo[83309]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:43 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.678s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:43 devstack cinder-volume[82488]: INFO cinder.volume.drivers.lvm [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 19 23:45:43 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:43 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:43 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:43 devstack sudo[83319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:43 devstack sudo[83319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:44 devstack sudo[83319]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.855s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:44 devstack cinder-volume[82488]: DEBUG cinder.volume.drivers.lvm [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Updating volume stats {{(pid=82488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 23:45:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:44 devstack sudo[83436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:45:44 devstack sudo[83436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:44 devstack cinder-volume[82315]: DEBUG dbcounter [-] [82315] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82315) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:45:44 devstack sudo[83436]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:44 devstack sudo[83563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:45:44 devstack sudo[83563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:45 devstack sudo[83563]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:45 devstack sudo[83581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:45 devstack sudo[83581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:46 devstack sudo[83581]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:46 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:46 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:46 devstack sudo[83584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:45:46 devstack sudo[83584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:46 devstack sudo[83584]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:46 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:46 devstack cinder-volume[82488]: INFO cinder.volume.driver [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 23:45:46 devstack cinder-volume[82488]: DEBUG cinder.volume.driver [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82488) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 23:45:46 devstack cinder-volume[82488]: DEBUG oslo_db.sqlalchemy.engines [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82488) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:45:46 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writer thread running {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 23:45:46 devstack cinder-volume[82488]: DEBUG cinder.db.api [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Building query based on filter {{(pid=82488) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 23:45:46 devstack cinder-volume[82488]: DEBUG cinder.image.image_utils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82488) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 23:45:47 devstack cinder-volume[82488]: INFO cinder.keymgr.migration [None req-2a0fb83e-52cb-4df9-81c9-eb8c62b5d9cb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 23:45:47 devstack cinder-volume[82488]: DEBUG cinder.volume.drivers.lvm [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Updating volume stats {{(pid=82488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 23:45:47 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:47 devstack sudo[83588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:45:47 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:47 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:47 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:47 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:47 devstack sudo[83595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:45:47 devstack sudo[83595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:48 devstack sudo[83595]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:48 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:48 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:48 devstack sudo[83598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:48 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:48 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:48 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:48 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:48 devstack sudo[83601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:45:48 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:49 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:49 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:49 devstack cinder-volume[82488]: DEBUG cinder.manager [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Notifying Schedulers of capabilities ... {{(pid=82488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:45:49 devstack cinder-volume[82488]: INFO cinder.volume.manager [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Driver initialization completed successfully. Jun 19 23:45:49 devstack cinder-volume[82488]: INFO cinder.manager [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Initiating service 2 cleanup Jun 19 23:45:49 devstack cinder-volume[82488]: INFO cinder.manager [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Service 2 cleanup completed. Jun 19 23:45:49 devstack cinder-volume[82488]: DEBUG cinder.service [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Creating RPC server for service cinder-volume {{(pid=82488) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 23:45:49 devstack cinder-volume[82488]: DEBUG cinder.service [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82488) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 23:45:49 devstack cinder-volume[82488]: INFO cinder.volume.manager [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 19 23:45:49 devstack cinder-volume[82488]: DEBUG cinder.volume.drivers.lvm [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Updating volume stats {{(pid=82488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 23:45:49 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:49 devstack sudo[83605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:45:49 devstack sudo[83605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:50 devstack sudo[83605]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:50 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:50 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:50 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:45:50 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:51 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:51 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:51 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:51 devstack sudo[83615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:45:51 devstack sudo[83615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:51 devstack sudo[83615]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:51 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:51 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:45:51 devstack sudo[83672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:45:51 devstack sudo[83672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:45:52 devstack sudo[83672]: pam_unix(sudo:session): session closed for user root Jun 19 23:45:52 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:45:52 devstack cinder-volume[82488]: INFO cinder.volume.manager [None req-60462e25-83ec-4d6d-9c89-0240391ed813 None None] Driver post RPC initialization completed successfully. Jun 19 23:46:02 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writing DB stats cinder:SELECT=4 {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:46:02 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:46:43 devstack cinder-volume[82488]: DEBUG oslo_service.periodic_task [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:46:43 devstack cinder-volume[82488]: DEBUG cinder.volume.drivers.lvm [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Updating volume stats {{(pid=82488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 23:46:43 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:46:43 devstack sudo[85327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:46:43 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:46:44 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root Jun 19 23:46:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:46:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:46:44 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:46:44 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:46:44 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Jun 19 23:46:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:46:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:46:44 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:46:44 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:46:45 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Jun 19 23:46:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:46:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:46:45 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:46:45 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:46:45 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Jun 19 23:46:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:46:45 devstack cinder-volume[82488]: DEBUG cinder.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Notifying Schedulers of capabilities ... {{(pid=82488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:46:46 devstack cinder-volume[82488]: DEBUG oslo_service.periodic_task [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running periodic task VolumeManager._thread_info {{(pid=82488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:46:46 devstack cinder-volume[82488]: DEBUG cinder.volume.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] thread count: 6 {{(pid=82488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:46:46 devstack cinder-volume[82488]: DEBUG cinder.volume.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] thread info: [<_MainThread(MainThread, started 134819233972352)>, , , , , ] {{(pid=82488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:47:43 devstack cinder-volume[82488]: DEBUG oslo_service.periodic_task [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:47:43 devstack cinder-volume[82488]: DEBUG cinder.volume.drivers.lvm [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Updating volume stats {{(pid=82488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 23:47:43 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:47:43 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:47:43 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:47:44 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Jun 19 23:47:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:47:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:47:44 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:47:44 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:47:44 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Jun 19 23:47:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:47:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:47:44 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:47:44 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:47:45 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Jun 19 23:47:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:47:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:47:45 devstack sudo[88578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:47:45 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:47:45 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root Jun 19 23:47:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:47:45 devstack cinder-volume[82488]: DEBUG cinder.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Notifying Schedulers of capabilities ... {{(pid=82488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:48:02 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writing DB stats cinder:SELECT=1 {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:48:02 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writing DB stats cinder:UPDATE=1 {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:48:43 devstack cinder-volume[82488]: DEBUG oslo_service.periodic_task [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:48:43 devstack cinder-volume[82488]: DEBUG cinder.volume.drivers.lvm [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Updating volume stats {{(pid=82488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 23:48:43 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:48:43 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:48:43 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:48:44 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Jun 19 23:48:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:48:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:48:44 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:48:44 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:48:44 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Jun 19 23:48:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:48:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:48:44 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:48:44 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:48:45 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Jun 19 23:48:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:48:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:48:45 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:48:45 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:48:46 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Jun 19 23:48:46 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:48:46 devstack cinder-volume[82488]: DEBUG cinder.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Notifying Schedulers of capabilities ... {{(pid=82488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:48:46 devstack cinder-volume[82488]: DEBUG oslo_service.periodic_task [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running periodic task VolumeManager._thread_info {{(pid=82488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:48:46 devstack cinder-volume[82488]: DEBUG cinder.volume.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] thread count: 6 {{(pid=82488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:48:46 devstack cinder-volume[82488]: DEBUG cinder.volume.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] thread info: [<_MainThread(MainThread, started 134819233972352)>, , , , , ] {{(pid=82488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:49:43 devstack cinder-volume[82488]: DEBUG oslo_service.periodic_task [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:49:43 devstack cinder-volume[82488]: DEBUG cinder.volume.drivers.lvm [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Updating volume stats {{(pid=82488) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 23:49:43 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:49:43 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 23:49:43 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:49:44 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Jun 19 23:49:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:49:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:49:44 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:49:44 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:49:44 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Jun 19 23:49:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:49:44 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:49:44 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 23:49:44 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:49:45 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Jun 19 23:49:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:49:45 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:49:45 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 23:49:45 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:49:46 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Jun 19 23:49:46 devstack cinder-volume[82488]: DEBUG oslo_concurrency.processutils [None req-33820e74-f308-4d2c-88dd-336197f936af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82488) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:49:46 devstack cinder-volume[82488]: DEBUG cinder.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Notifying Schedulers of capabilities ... {{(pid=82488) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:49:46 devstack cinder-volume[82488]: DEBUG oslo_service.periodic_task [None req-33820e74-f308-4d2c-88dd-336197f936af None None] Running periodic task VolumeManager._thread_info {{(pid=82488) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:49:46 devstack cinder-volume[82488]: DEBUG cinder.volume.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] thread count: 6 {{(pid=82488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:49:46 devstack cinder-volume[82488]: DEBUG cinder.volume.manager [None req-33820e74-f308-4d2c-88dd-336197f936af None None] thread info: [<_MainThread(MainThread, started 134819233972352)>, , , , , ] {{(pid=82488) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:50:02 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writing DB stats cinder:SELECT=1 {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:50:02 devstack cinder-volume[82488]: DEBUG dbcounter [-] [82488] Writing DB stats cinder:UPDATE=1 {{(pid=82488) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:50:36 devstack cinder-volume[82315]: INFO oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Caught SIGTERM, stopping children Jun 19 23:50:36 devstack cinder-volume[82315]: DEBUG oslo_concurrency.lockutils [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Acquiring lock "singleton_lock" {{(pid=82315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 23:50:36 devstack cinder-volume[82315]: DEBUG oslo_concurrency.lockutils [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Acquired lock "singleton_lock" {{(pid=82315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 23:50:36 devstack cinder-volume[82315]: DEBUG oslo_concurrency.lockutils [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Releasing lock "singleton_lock" {{(pid=82315) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 23:50:36 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Stop services. {{(pid=82315) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 19 23:50:36 devstack cinder-volume[82315]: DEBUG oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Killing children. {{(pid=82315) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 19 23:50:36 devstack cinder-volume[82315]: INFO oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Waiting on 1 children to exit Jun 19 23:50:39 devstack cinder-volume[82488]: DEBUG oslo_concurrency.lockutils [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Acquiring lock "singleton_lock" {{(pid=82488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 23:50:39 devstack cinder-volume[82488]: DEBUG oslo_concurrency.lockutils [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Acquired lock "singleton_lock" {{(pid=82488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 23:50:39 devstack cinder-volume[82488]: DEBUG oslo_concurrency.lockutils [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Releasing lock "singleton_lock" {{(pid=82488) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 23:50:39 devstack cinder-volume[82488]: WARNING amqp [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 23:50:39 devstack cinder-volume[82488]: WARNING amqp [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 23:50:39 devstack cinder-volume[82315]: INFO oslo_service.backend._eventlet.service [None req-1e466c48-1188-4d8a-8d10-800b8e2339a5 None None] Child 82488 exited with status 0 Jun 19 23:50:40 devstack cinder-volume[92587]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 23:50:40 devstack cinder-volume[92587]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 23:50:40 devstack cinder-volume[92587]: we strongly recommend against using it for new projects. Jun 19 23:50:40 devstack cinder-volume[92587]: If you are already using Eventlet, we recommend migrating to a different Jun 19 23:50:40 devstack cinder-volume[92587]: framework. For more detail see Jun 19 23:50:40 devstack cinder-volume[92587]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 23:50:40 devstack cinder-volume[92587]: import eventlet # noqa Jun 19 23:50:42 devstack cinder-volume[92587]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 23:50:42 devstack cinder-volume[92587]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 23:50:42 devstack cinder-volume[92587]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 23:50:42 devstack cinder-volume[92587]: INFO dbcounter [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Registered counter for database cinder Jun 19 23:50:42 devstack cinder-volume[92587]: DEBUG oslo_db.sqlalchemy.engines [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG dbcounter [-] [92587] Writer thread running {{(pid=92587) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 23:50:43 devstack cinder-volume[92587]: INFO cinder.rpc [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 23:50:43 devstack cinder-volume[92587]: INFO cinder.rpc [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_db.sqlalchemy.engines [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:50:43 devstack cinder-volume[92587]: INFO cinder.volume.manager [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Determined volume DB was empty at startup. Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG cinder.volume.manager [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92587) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 23:50:43 devstack cinder-volume[92587]: INFO cinder.volume.manager [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 19 23:50:43 devstack cinder-volume[92587]: WARNING stevedore.named [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 23:50:43 devstack cinder-volume[92587]: WARNING castellan.key_manager [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 23:50:43 devstack cinder-volume[92587]: WARNING cinder.keymgr.conf_key_mgr [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 23:50:43 devstack cinder-volume[92587]: INFO cinder.volume.manager [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_db.sqlalchemy.engines [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:50:43 devstack cinder-volume[92587]: INFO oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Starting 1 workers Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Started child 92802 {{(pid=92587) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Full set of CONF: {{(pid=92587) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] ******************************************************************************** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Configuration options gathered from: {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] ================================================================================ {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 23:50:43 devstack cinder-volume[92802]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] allow_availability_zone_fallback = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] allow_compression_on_image_upload = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] allowed_direct_url_schemes = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] api_rate_limit = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] auth_strategy = keystone {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_availability_zone = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_host = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_stats_polling_interval = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backup_api_class = cinder.backup.api.API {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backup_name_template = backup-%s {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backup_use_same_host = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backup_use_temp_snapshot = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] chap_password = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] chap_username = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_internal_tenant_project_id = a4538a10c8cb481882520ce0510ed78d {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_internal_tenant_user_id = 261325e6e81044c9aad0d60305f7f3fa {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cluster = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] compression_format = gzip {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] compute_api_class = cinder.compute.nova.API {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] config_dir = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] config_source = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] control_exchange = openstack {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] debug = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] default_availability_zone = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] default_group_type = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] default_volume_type = QuobyteHD {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] disk_geometry = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] driver_client_cert = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] driver_client_cert_key = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] driver_data_namespace = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] driver_ssl_cert_path = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] driver_ssl_cert_verify = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] driver_use_ssl = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] enable_new_services = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] enable_unsupported_driver = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] enabled_backends = ['QuobyteHD'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] enforce_multipath_for_image_xfer = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] filter_function = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_api_insecure = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_api_ssl_compression = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_ca_certificates_file = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_catalog_info = image:glance:publicURL {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_certfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_keyfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_num_retries = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance_request_timeout = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] goodness_function = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] graceful_shutdown_timeout = 5 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] group_api_class = cinder.group.api.API {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] host = devstack {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_compress_on_upload = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_conversion_address_space_limit = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_conversion_cpu_limit = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_conversion_disable = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_upload_use_cinder_backend = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_upload_use_internal_tenant = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_volume_cache_enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_volume_cache_max_count = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] image_volume_cache_max_size_gb = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] init_host_max_objects_retrieval = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] instance_format = [instance: %(uuid)s] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] iscsi_target_flags = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] iscsi_write_cache = on {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] iser_helper = tgtadm {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] iser_ip_address = 192.168.122.215 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] iser_port = 3260 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92802]: INFO cinder.volume.manager [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 19 23:50:43 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.remotefs [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92802) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_color = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_config_append = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_dir = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_file = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_options = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_rotate_interval = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_rotate_interval_type = days {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] log_rotation_type = none {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] max_age = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] max_logfile_count = 30 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] max_logfile_size_mb = 200 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] max_over_subscription_ratio = 20.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] message_reap_interval = 86400 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] message_ttl = 2592000 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] migration_create_volume_timeout_secs = 300 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] monkey_patch = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] monkey_patch_modules = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] my_ip = 192.168.122.215 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] no_snapshot_gb_quota = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] num_iser_scan_tries = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] num_shell_tries = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] num_volume_device_scan_tries = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] nvmeof_conn_info_version = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] nvmet_ns_id = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] nvmet_port_id = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] osapi_max_limit = 1000 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] osapi_volume_ext_list = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] osapi_volume_listen = 0.0.0.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] osapi_volume_listen_port = 8776 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] osapi_volume_use_ssl = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] osapi_volume_workers = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] per_volume_size_limit = -1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] periodic_fuzzy_delay = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] periodic_interval = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] project_id_regex = [0-9a-f\-]+ {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] public_endpoint = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] publish_errors = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] quota_backup_gigabytes = 1000 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] quota_backups = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] quota_gigabytes = 1000 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] quota_groups = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] quota_snapshots = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] quota_volumes = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] rate_limit_burst = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] rate_limit_except_level = CRITICAL {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] rate_limit_interval = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] reinit_driver_count = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] replication_device = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] report_discard_supported = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] report_interval = 120 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] reservation_clean_interval = 86400 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] reservation_expire = 86400 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] reserved_image_namespaces = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] reserved_percentage = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] rpc_response_timeout = 120 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] run_external_periodic_tasks = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] scst_target_driver = iscsi {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] scst_target_iqn_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_down_time = 720 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] shell_completion = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] snapshot_name_template = snapshot-%s {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] split_loggers = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] state_path = /opt/stack/data/cinder {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] storage_availability_zone = nova {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] storage_protocol = iSCSI {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] syslog_log_facility = LOG_USER {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] target_helper = lioadm {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] target_ip_address = 192.168.122.215 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] target_port = 3260 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] target_protocol = iscsi {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] target_secondary_ip_addresses = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] trace_flags = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] transfer_api_class = cinder.transfer.api.API {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] transport_url = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] until_refresh = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] use_chap_auth = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] use_default_quota_class = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] use_journal = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] use_json = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] use_multipath_for_image_xfer = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] use_stderr = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] use_syslog = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] verify_glance_signatures = enabled {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_api_class = cinder.volume.api.API {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_backend_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_clear = zero {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_clear_ionice = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_clear_size = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_copy_bps_limit = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_dd_blocksize = 1M {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_name_template = volume-%s {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_service_inithost_offload = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volume_usage_audit_period = month {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] zoning_mode = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_concurrency.disable_process_locking = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.auth_section = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.auth_type = password {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.auth_version = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.cache = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.certfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.delay_auth_decision = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.http_connect_timeout = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.include_service_catalog = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.insecure = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.interface = public {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.keyfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_password = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcache_username = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.region_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.service_token_roles_required = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.service_type = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.token_cache_time = 300 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.backend = dogpile.cache.null {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.backend_argument = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.backend_expiration_time = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.config_prefix = cache.oslo {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.debug_cache_backend = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.enable_retry_client = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.enable_socket_keepalive = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.expiration_time = 600 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.hashclient_retry_attempts = 2 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.memcache_dead_retry = 300 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.memcache_pool_maxsize = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.memcache_sasl_enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.password = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.proxies = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.redis_db = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.redis_sentinel_service_name = mymaster {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.redis_server = localhost:6379 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.retry_attempts = 2 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.retry_delay = 0.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.socket_keepalive_count = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.socket_keepalive_idle = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.socket_keepalive_interval = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.socket_timeout = 1.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.tls_allowed_ciphers = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.tls_cafile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.tls_certfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.tls_enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.tls_keyfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cache.username = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] coordination.backend_url = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.asyncio_connection = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.asyncio_slave_connection = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.backend = sqlalchemy {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.connection = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.connection_debug = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.connection_parameters = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.connection_recycle_time = 3600 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.connection_trace = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.db_inc_retry_interval = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.db_max_retries = 20 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.db_max_retry_interval = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.db_retry_interval = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.max_overflow = 50 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.max_pool_size = 5 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.max_retries = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.mysql_wsrep_sync_wait = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.pool_timeout = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.retry_interval = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.slave_connection = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.sqlite_synchronous = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.synchronous_reader = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] database.use_db_reconnect = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.connection_string = messaging:// {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.es_doc_type = notification {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.es_scroll_size = 10000 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.es_scroll_time = 2m {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.filter_error_trace = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.hmac_keys = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.sentinel_service_name = mymaster {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.socket_timeout = 0.1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.trace_requests = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler.trace_sqlalchemy = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler_jaeger.process_tags = {} {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler_jaeger.service_name_prefix = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] profiler_otlp.service_name_prefix = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.enforce_new_defaults = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: WARNING oslo_config.cfg [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.enforce_scope = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.policy_default_rule = default {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.policy_file = policy.yaml {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92802) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 19 23:50:43 devstack cinder-volume[92802]: WARNING cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92802]: WARNING cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_policy.remote_timeout = 60.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] privsep_osbrick.group = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Running cmd (subprocess): mount.quobyte {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] privsep_osbrick.helper_command = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] privsep_osbrick.user = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_sys_admin.group = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_sys_admin.helper_command = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] cinder_sys_admin.user = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.auth_section = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.auth_type = password {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.cafile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.certfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.collect_timing = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.insecure = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.keyfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.send_service_user_token = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.split_loggers = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] service_user.timeout = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.auth_section = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.auth_type = password {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.certfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.collect_timing = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.insecure = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.keyfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.region_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.split_loggers = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] glance.timeout = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.backend_availability_zone = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.chap_password = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.chap_username = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.disk_geometry = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.driver_client_cert = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.driver_client_cert_key = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.driver_data_namespace = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.driver_use_ssl = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.enable_unsupported_driver = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.extra_capabilities = {} {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.filter_function = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.goodness_function = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.iscsi_target_flags = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.iscsi_write_cache = on {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.iser_helper = tgtadm {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.iser_port = 3260 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_host = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_login = admin {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_mount_options = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_password = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_private_key = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_share_path = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_ssh_port = 22 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.num_shell_tries = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.nvmet_port_id = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.quobyte_client_cfg = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.quobyte_volume_url = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.replication_device = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.report_discard_supported = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.reserved_percentage = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.scst_target_driver = iscsi {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.scst_target_iqn_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.storage_protocol = iSCSI {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.target_helper = tgtadm {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.target_port = 3260 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.target_protocol = iscsi {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.trace_flags = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.unique_fqdn_network = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.use_chap_auth = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volume_backend_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volume_clear = zero {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volume_clear_ionice = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volume_clear_size = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_reports.file_event_handler = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_reports.log_dir = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.backend_availability_zone = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.backend_host = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.chap_password = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.chap_username = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.chiscsi_conf = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.disk_geometry = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.driver_client_cert = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.driver_client_cert_key = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.driver_data_namespace = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.driver_use_ssl = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.extra_capabilities = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.filter_function = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.goodness_function = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.iscsi_target_flags = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.iscsi_write_cache = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.iser_helper = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.iser_ip_address = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.iser_port = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.iser_target_prefix = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_host = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_login = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_mount_options = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_password = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_private_key = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_share_path = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_ssh_port = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.num_shell_tries = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nvmet_ns_id = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.nvmet_port_id = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.replication_device = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.report_discard_supported = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.reserved_percentage = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.scst_target_driver = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.storage_protocol = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.target_helper = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.target_ip_address = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.target_port = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.target_prefix = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.target_protocol = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.trace_flags = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.unique_fqdn_network = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.use_chap_auth = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volume_clear = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volume_clear_ionice = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volume_clear_size = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] QuobyteHD.volumes_dir = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.ssl = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.ssl_version = {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_notifications.driver = [] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_notifications.retry = -1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] oslo_messaging_notifications.transport_url = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] key_manager.fixed_key = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.barbican_api_version = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.barbican_endpoint = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.barbican_endpoint_type = public {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.barbican_region_name = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.cafile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.certfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.collect_timing = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.insecure = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.keyfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.number_of_retries = 60 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.retry_delay = 1 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.send_service_user_token = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.split_loggers = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.timeout = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.verify_ssl = True {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican.verify_ssl_path = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.auth_section = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.auth_type = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.cafile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.certfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.collect_timing = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.insecure = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack quobyte-client[92807]: Reading configuration file: /etc/quobyte/client.cfg Jun 19 23:50:43 devstack quobyte-client[92807]: Invalid parameters found, error: missing mount point. Jun 19 23:50:43 devstack quobyte-client[92807]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.keyfile = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.split_loggers = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] barbican_service_user.timeout = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack quobyte-client[92807]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.approle_role_id = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.approle_secret_id = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.kv_mountpoint = secret {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:43 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] CMD "mount.quobyte" returned: 1 in 0.121s {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.kv_path = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.kv_version = 2 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:44 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.namespace = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:44 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.root_token_id = **** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.ssl_ca_crt_file = None {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.timeout = 60.0 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.use_ssl = False {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:50:44 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=92802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:50:44 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] ******************************************************************************** {{(pid=92587) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 23:50:44 devstack cinder-volume[92802]: INFO cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 ... Jun 19 23:50:44 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df -c /etc/quobyte/client-cinder.cfg {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:50:44 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df -c /etc/quobyte/client-cinder.cfg Jun 19 23:50:44 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:50:44 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Jun 19 23:50:44 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.768s {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:50:44 devstack cinder-volume[92802]: INFO cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 succeeded Jun 19 23:50:44 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=92802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:50:44 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.783s {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:50:44 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:50:44 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:50:44 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:50:45 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.606s {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:50:45 devstack cinder-volume[92802]: INFO cinder.volume.driver [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG cinder.volume.driver [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92802) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG oslo_db.sqlalchemy.engines [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92802) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG dbcounter [-] [92802] Writer thread running {{(pid=92802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG cinder.db.api [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Building query based on filter {{(pid=92802) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG cinder.image.image_utils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92802) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 23:50:45 devstack cinder-volume[92802]: INFO cinder.keymgr.migration [None req-f695a5ed-6254-41e4-be48-2622a4c46b5f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=92802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=92802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:50:45 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:50:45 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:50:45 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:50:46 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.620s {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG cinder.manager [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Notifying Schedulers of capabilities ... {{(pid=92802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:50:46 devstack cinder-volume[92802]: INFO cinder.volume.manager [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Driver initialization completed successfully. Jun 19 23:50:46 devstack cinder-volume[92802]: INFO cinder.manager [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Initiating service 3 cleanup Jun 19 23:50:46 devstack cinder-volume[92802]: INFO cinder.manager [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Service 3 cleanup completed. Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG cinder.service [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Creating RPC server for service cinder-volume {{(pid=92802) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG cinder.service [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92802) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 23:50:46 devstack cinder-volume[92802]: INFO cinder.volume.manager [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=92802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=92802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:50:46 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:50:46 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:50:46 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:50:47 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Jun 19 23:50:47 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.686s {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:50:47 devstack cinder-volume[92802]: INFO cinder.volume.manager [None req-dda07f8a-6d99-4df5-891f-2fd429430e79 None None] Driver post RPC initialization completed successfully. Jun 19 23:50:51 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-6de25f37-1df0-40b2-ab6b-121d95739343 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:50:51 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-6de25f37-1df0-40b2-ab6b-121d95739343 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:50:51 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-6de25f37-1df0-40b2-ab6b-121d95739343 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=92802) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:50:51 devstack cinder-volume[92802]: DEBUG cinder.volume.drivers.quobyte [None req-6de25f37-1df0-40b2-ab6b-121d95739343 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=92802) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:50:51 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-6de25f37-1df0-40b2-ab6b-121d95739343 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92802) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:50:51 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-6de25f37-1df0-40b2-ab6b-121d95739343 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:50:51 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:50:51 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:50:51 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Jun 19 23:50:51 devstack cinder-volume[92802]: DEBUG oslo_concurrency.processutils [None req-6de25f37-1df0-40b2-ab6b-121d95739343 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.604s {{(pid=92802) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:50:51 devstack cinder-volume[92802]: DEBUG cinder.manager [None req-6de25f37-1df0-40b2-ab6b-121d95739343 None None] Notifying Schedulers of capabilities ... {{(pid=92802) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:50:53 devstack cinder-volume[92587]: INFO oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Caught SIGTERM, stopping children Jun 19 23:50:53 devstack cinder-volume[92587]: DEBUG oslo_concurrency.lockutils [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Acquiring lock "singleton_lock" {{(pid=92587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 23:50:53 devstack cinder-volume[92587]: DEBUG oslo_concurrency.lockutils [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Acquired lock "singleton_lock" {{(pid=92587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 23:50:53 devstack cinder-volume[92587]: DEBUG oslo_concurrency.lockutils [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Releasing lock "singleton_lock" {{(pid=92587) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 23:50:53 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Stop services. {{(pid=92587) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 19 23:50:53 devstack cinder-volume[92587]: DEBUG oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Killing children. {{(pid=92587) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 19 23:50:53 devstack cinder-volume[92587]: INFO oslo_service.backend._eventlet.service [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Waiting on 1 children to exit Jun 19 23:50:56 devstack cinder-volume[92802]: DEBUG dbcounter [-] [92802] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:50:57 devstack cinder-volume[92802]: DEBUG dbcounter [-] [92802] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=92802) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:50:58 devstack cinder-volume[92802]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 19 23:50:58 devstack cinder-volume[93101]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 23:50:58 devstack cinder-volume[93101]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 23:50:58 devstack cinder-volume[93101]: we strongly recommend against using it for new projects. Jun 19 23:50:58 devstack cinder-volume[93101]: If you are already using Eventlet, we recommend migrating to a different Jun 19 23:50:58 devstack cinder-volume[93101]: framework. For more detail see Jun 19 23:50:58 devstack cinder-volume[93101]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 23:50:58 devstack cinder-volume[93101]: import eventlet # noqa Jun 19 23:50:59 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Acquiring lock "singleton_lock" {{(pid=92802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 23:50:59 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Acquired lock "singleton_lock" {{(pid=92802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 23:50:59 devstack cinder-volume[92802]: DEBUG oslo_concurrency.lockutils [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Releasing lock "singleton_lock" {{(pid=92802) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 23:50:59 devstack cinder-volume[92802]: WARNING amqp [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 23:50:59 devstack cinder-volume[92802]: WARNING amqp [None req-d23ffa52-1252-4093-bfad-1b3e6ac9fccc None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 23:51:01 devstack cinder-volume[93101]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 23:51:01 devstack cinder-volume[93101]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 23:51:01 devstack cinder-volume[93101]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 23:51:02 devstack cinder-volume[93101]: INFO dbcounter [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Registered counter for database cinder Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_db.sqlalchemy.engines [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG dbcounter [-] [93101] Writer thread running {{(pid=93101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 23:51:02 devstack cinder-volume[93101]: INFO cinder.rpc [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 23:51:02 devstack cinder-volume[93101]: INFO cinder.rpc [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_db.sqlalchemy.engines [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:51:02 devstack cinder-volume[93101]: INFO cinder.volume.manager [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Determined volume DB was empty at startup. Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG cinder.volume.manager [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93101) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 23:51:02 devstack cinder-volume[93101]: WARNING stevedore.named [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 23:51:02 devstack cinder-volume[93101]: WARNING castellan.key_manager [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 23:51:02 devstack cinder-volume[93101]: WARNING cinder.keymgr.conf_key_mgr [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 23:51:02 devstack cinder-volume[93101]: INFO cinder.volume.manager [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_db.sqlalchemy.engines [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:51:02 devstack cinder-volume[93101]: INFO oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Starting 1 workers Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Started child 93391 {{(pid=93101) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Full set of CONF: {{(pid=93101) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] ******************************************************************************** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Configuration options gathered from: {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] ================================================================================ {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] allow_availability_zone_fallback = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] allow_compression_on_image_upload = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] allowed_direct_url_schemes = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] api_rate_limit = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] auth_strategy = keystone {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93391]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_availability_zone = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_host = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_stats_polling_interval = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backup_api_class = cinder.backup.api.API {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backup_name_template = backup-%s {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backup_use_same_host = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backup_use_temp_snapshot = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] chap_password = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] chap_username = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_internal_tenant_project_id = a4538a10c8cb481882520ce0510ed78d {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_internal_tenant_user_id = 261325e6e81044c9aad0d60305f7f3fa {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cluster = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] compression_format = gzip {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] compute_api_class = cinder.compute.nova.API {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] config_dir = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] config_source = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] control_exchange = openstack {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] debug = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] default_availability_zone = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] default_group_type = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] default_volume_type = QuobyteHD {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] disk_geometry = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] driver_client_cert = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] driver_client_cert_key = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] driver_data_namespace = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] driver_ssl_cert_path = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] driver_ssl_cert_verify = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] driver_use_ssl = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] enable_new_services = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] enable_unsupported_driver = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] enabled_backends = ['QuobyteHD'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] enforce_multipath_for_image_xfer = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] filter_function = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_api_insecure = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_api_ssl_compression = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_ca_certificates_file = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_catalog_info = image:glance:publicURL {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_certfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_keyfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_num_retries = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance_request_timeout = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] goodness_function = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] graceful_shutdown_timeout = 5 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] group_api_class = cinder.group.api.API {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] host = devstack {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_compress_on_upload = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_conversion_address_space_limit = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_conversion_cpu_limit = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_conversion_disable = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_upload_use_cinder_backend = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_upload_use_internal_tenant = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_volume_cache_enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_volume_cache_max_count = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] image_volume_cache_max_size_gb = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] init_host_max_objects_retrieval = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] instance_format = [instance: %(uuid)s] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] iscsi_target_flags = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] iscsi_write_cache = on {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] iser_helper = tgtadm {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] iser_ip_address = 192.168.122.215 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] iser_port = 3260 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_color = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_config_append = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_dir = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_file = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_options = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_rotate_interval = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_rotate_interval_type = days {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] log_rotation_type = none {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] max_age = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] max_logfile_count = 30 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] max_logfile_size_mb = 200 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] max_over_subscription_ratio = 20.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] message_reap_interval = 86400 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] message_ttl = 2592000 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] migration_create_volume_timeout_secs = 300 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] monkey_patch = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] monkey_patch_modules = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] my_ip = 192.168.122.215 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] no_snapshot_gb_quota = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-51989534-8a54-4922-ab47-418f6249b924 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93391) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] num_iser_scan_tries = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] num_shell_tries = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] num_volume_device_scan_tries = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] nvmeof_conn_info_version = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] nvmet_ns_id = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] nvmet_port_id = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] osapi_max_limit = 1000 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] osapi_volume_ext_list = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] osapi_volume_listen_port = 8776 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] osapi_volume_use_ssl = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] osapi_volume_workers = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] per_volume_size_limit = -1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] periodic_fuzzy_delay = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] periodic_interval = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] public_endpoint = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] publish_errors = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] quota_backup_gigabytes = 1000 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] quota_backups = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] quota_gigabytes = 1000 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] quota_groups = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] quota_snapshots = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] quota_volumes = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] rate_limit_burst = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] rate_limit_except_level = CRITICAL {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] rate_limit_interval = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] reinit_driver_count = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] replication_device = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] report_discard_supported = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] report_interval = 120 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] reservation_clean_interval = 86400 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] reservation_expire = 86400 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] reserved_image_namespaces = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] reserved_percentage = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] rpc_response_timeout = 120 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] run_external_periodic_tasks = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] scst_target_driver = iscsi {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] scst_target_iqn_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_down_time = 720 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] shell_completion = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] snapshot_name_template = snapshot-%s {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] split_loggers = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] state_path = /opt/stack/data/cinder {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] storage_availability_zone = nova {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] storage_protocol = iSCSI {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] syslog_log_facility = LOG_USER {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] target_helper = lioadm {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] target_ip_address = 192.168.122.215 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] target_port = 3260 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] target_protocol = iscsi {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] target_secondary_ip_addresses = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] trace_flags = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] transport_url = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] until_refresh = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] use_chap_auth = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] use_default_quota_class = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] use_journal = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] use_json = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] use_multipath_for_image_xfer = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] use_stderr = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] use_syslog = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] verify_glance_signatures = enabled {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_api_class = cinder.volume.api.API {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_backend_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_clear = zero {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_clear_ionice = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_clear_size = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_copy_bps_limit = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_dd_blocksize = 1M {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_name_template = volume-%s {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_service_inithost_offload = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volume_usage_audit_period = month {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] zoning_mode = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_concurrency.disable_process_locking = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.auth_section = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.auth_type = password {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.auth_version = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.cache = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.certfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.include_service_catalog = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.insecure = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.interface = public {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.keyfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_password = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcache_username = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.region_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.service_type = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.backend = dogpile.cache.null {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.backend_argument = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.backend_expiration_time = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.config_prefix = cache.oslo {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.debug_cache_backend = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.enable_retry_client = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.enable_socket_keepalive = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.expiration_time = 600 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.hashclient_retry_attempts = 2 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.memcache_dead_retry = 300 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.memcache_pool_maxsize = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.memcache_sasl_enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.password = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.proxies = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.redis_db = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.redis_server = localhost:6379 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.retry_attempts = 2 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.retry_delay = 0.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.socket_keepalive_count = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.socket_keepalive_idle = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.socket_keepalive_interval = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.socket_timeout = 1.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.tls_allowed_ciphers = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.tls_cafile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93391) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 19 23:51:02 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.tls_certfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.tls_enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.tls_keyfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cache.username = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] coordination.backend_url = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.asyncio_connection = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.asyncio_slave_connection = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.backend = sqlalchemy {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Running cmd (subprocess): mount.quobyte {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.connection = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.connection_debug = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.connection_parameters = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.connection_recycle_time = 3600 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.connection_trace = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.db_inc_retry_interval = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.db_max_retries = 20 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.db_max_retry_interval = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.db_retry_interval = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.max_overflow = 50 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.max_pool_size = 5 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.max_retries = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.mysql_wsrep_sync_wait = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.pool_timeout = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.retry_interval = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.slave_connection = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.sqlite_synchronous = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.synchronous_reader = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] database.use_db_reconnect = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.connection_string = messaging:// {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.es_doc_type = notification {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.es_scroll_size = 10000 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.es_scroll_time = 2m {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.filter_error_trace = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.hmac_keys = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.sentinel_service_name = mymaster {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.socket_timeout = 0.1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.trace_requests = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler.trace_sqlalchemy = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler_jaeger.process_tags = {} {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler_jaeger.service_name_prefix = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] profiler_otlp.service_name_prefix = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.enforce_new_defaults = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: WARNING oslo_config.cfg [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.enforce_scope = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.policy_default_rule = default {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.policy_file = policy.yaml {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] privsep_osbrick.group = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] privsep_osbrick.helper_command = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] privsep_osbrick.user = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_sys_admin.group = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_sys_admin.helper_command = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] cinder_sys_admin.user = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.auth_section = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.auth_type = password {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.cafile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.certfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.collect_timing = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.insecure = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.keyfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.send_service_user_token = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.split_loggers = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] service_user.timeout = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.auth_section = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.auth_type = password {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.certfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.collect_timing = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.insecure = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.keyfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.region_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.split_loggers = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] glance.timeout = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.backend_availability_zone = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.chap_password = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.chap_username = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.disk_geometry = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.driver_client_cert = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.driver_client_cert_key = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.driver_data_namespace = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.driver_use_ssl = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.extra_capabilities = {} {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.filter_function = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.goodness_function = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.iscsi_target_flags = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.iscsi_write_cache = on {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.iser_helper = tgtadm {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.iser_port = 3260 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_host = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_login = admin {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_mount_options = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_password = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_private_key = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_share_path = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.num_shell_tries = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.quobyte_volume_url = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.replication_device = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.report_discard_supported = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.reserved_percentage = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.target_helper = tgtadm {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.target_port = 3260 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.target_protocol = iscsi {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.trace_flags = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.unique_fqdn_network = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.use_chap_auth = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volume_backend_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volume_clear = zero {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volume_clear_ionice = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volume_clear_size = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_reports.file_event_handler = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_reports.log_dir = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.backend_availability_zone = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.backend_host = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.chap_password = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.chap_username = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.chiscsi_conf = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.disk_geometry = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.driver_client_cert = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.driver_data_namespace = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.driver_use_ssl = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.extra_capabilities = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.filter_function = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.goodness_function = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.iser_helper = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.iser_ip_address = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.iser_port = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.iser_target_prefix = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_host = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_login = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_mount_options = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_password = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_private_key = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_share_path = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_ssh_port = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.num_shell_tries = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.nvmet_port_id = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.replication_device = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.report_discard_supported = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.reserved_percentage = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.scst_target_driver = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.storage_protocol = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack quobyte-client[93392]: Reading configuration file: /etc/quobyte/client.cfg Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.target_helper = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.target_ip_address = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.target_port = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.target_prefix = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.target_protocol = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack quobyte-client[93392]: Invalid parameters found, error: missing mount point. Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.trace_flags = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.use_chap_auth = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volume_clear = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack quobyte-client[93392]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volume_clear_size = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack quobyte-client[93392]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] QuobyteHD.volumes_dir = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:51:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.ssl = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_notifications.driver = [] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_notifications.retry = -1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] key_manager.fixed_key = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.barbican_api_version = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.barbican_endpoint = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.barbican_endpoint_type = public {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.barbican_region_name = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.cafile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.certfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.collect_timing = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.insecure = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.keyfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.number_of_retries = 60 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.retry_delay = 1 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.send_service_user_token = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.split_loggers = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.timeout = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.verify_ssl = True {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican.verify_ssl_path = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.auth_section = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.auth_type = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.cafile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.certfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.collect_timing = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.insecure = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.keyfile = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.split_loggers = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] barbican_service_user.timeout = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.approle_role_id = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.approle_secret_id = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.kv_mountpoint = secret {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.kv_path = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.kv_version = 2 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.namespace = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.root_token_id = **** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.ssl_ca_crt_file = None {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.timeout = 60.0 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.use_ssl = False {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 23:51:02 devstack cinder-volume[93101]: DEBUG oslo_service.backend._eventlet.service [None req-f6664616-9d75-48c3-b15c-fc772dd1c3a1 None None] ******************************************************************************** {{(pid=93101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 23:51:03 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.641s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:51:03 devstack cinder-volume[93391]: INFO cinder.volume.driver [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG cinder.volume.driver [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93391) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG oslo_db.sqlalchemy.engines [None req-51989534-8a54-4922-ab47-418f6249b924 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writer thread running {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG cinder.db.api [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Building query based on filter {{(pid=93391) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93391) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:51:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:51:03 devstack cinder-volume[93391]: INFO cinder.keymgr.migration [None req-b6e9277e-2720-44c8-87cc-d2ba18dba6c5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 23:51:03 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:51:03 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:51:04 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.604s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:51:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Driver initialization completed successfully. Jun 19 23:51:04 devstack cinder-volume[93391]: INFO cinder.manager [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Initiating service 3 cleanup Jun 19 23:51:04 devstack cinder-volume[93391]: INFO cinder.manager [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Service 3 cleanup completed. Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG cinder.service [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Creating RPC server for service cinder-volume {{(pid=93391) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG cinder.service [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93391) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 23:51:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:51:04 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:51:04 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:51:04 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Jun 19 23:51:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-51989534-8a54-4922-ab47-418f6249b924 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.600s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:51:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-51989534-8a54-4922-ab47-418f6249b924 None None] Driver post RPC initialization completed successfully. Jun 19 23:51:12 devstack cinder-volume[93101]: DEBUG dbcounter [-] [93101] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:51:14 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=3 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:51:14 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:51:27 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:51:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 6 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:51:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Flow 'volume_create_manager' (3478fdb6-be1a-4d22-81e8-a18e9a54f5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e5b776-aba1-4194-8f66-18a0e8e63824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e5b776-aba1-4194-8f66-18a0e8e63824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1484117954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd824116-7f57-4d9d-9ecc-1e021bcc062f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd19cc1f1214e0f9e9a05129e830355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:52:18Z,use_quota=True,user_id='04b45eb9135e44c2ac2c4e7daf9a7b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d081df76-b806-49ab-a2ed-046f3fcef21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d081df76-b806-49ab-a2ed-046f3fcef21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806b7331-a09e-455d-9056-421b8ce6909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806b7331-a09e-455d-9056-421b8ce6909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd824116-7f57-4d9d-9ecc-1e021bcc062f', 'volume_name': 'volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a39cb58-c2b4-4e9c-af9f-6546b2f1bcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a39cb58-c2b4-4e9c-af9f-6546b2f1bcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10aa21eb-df84-4dca-8bfa-529408536673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:17 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Volume fd824116-7f57-4d9d-9ecc-1e021bcc062f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f', 'volume_size': 1} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1484117954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd824116-7f57-4d9d-9ecc-1e021bcc062f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bd19cc1f1214e0f9e9a05129e830355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:52:18Z,use_quota=True,user_id='04b45eb9135e44c2ac2c4e7daf9a7b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Creating volume fd824116-7f57-4d9d-9ecc-1e021bcc062f {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:52:17 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:52:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:17 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f 1073741824 Jun 19 23:52:17 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:19 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f 1073741824" returned: 0 in 2.034s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:20 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f Jun 19 23:52:20 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:21 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f" returned: 0 in 1.485s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] <== create_volume: return (3601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:52:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.607s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:52:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10aa21eb-df84-4dca-8bfa-529408536673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f6c852-ed9a-4fc5-9ee1-71cae991beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:21 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Volume volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f (fd824116-7f57-4d9d-9ecc-1e021bcc062f): created successfully Jun 19 23:52:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f6c852-ed9a-4fc5-9ee1-71cae991beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Flow 'volume_create_manager' (3478fdb6-be1a-4d22-81e8-a18e9a54f5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:52:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e84e665e-3296-450c-80af-48dd156862b1 tempest-DeleteServersTestJSON-897734001 None] Created volume successfully. Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Flow 'volume_create_manager' (ea21c469-c83d-4be3-9a15-7f0fe061fa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a005935b-a415-4e61-9a5c-7f3b89818063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a005935b-a415-4e61-9a5c-7f3b89818063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-672934312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b4c6d0-13d6-45e4-850b-06a423857e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c1341c8f01475682c83dcda506764c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:52:25Z,use_quota=True,user_id='77a1f58fc24e4f72ad3bb81b6a6548b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf540c52-4105-4649-b281-ed0f34468b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf540c52-4105-4649-b281-ed0f34468b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c19f7d-4f76-4e07-a007-80c4a27c67a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65c19f7d-4f76-4e07-a007-80c4a27c67a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b4c6d0-13d6-45e4-850b-06a423857e73', 'volume_name': 'volume-c9b4c6d0-13d6-45e4-850b-06a423857e73', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63988ae4-b28b-4b12-a464-1976601852d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63988ae4-b28b-4b12-a464-1976601852d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8bd542-cd64-461a-8b0a-e9153cca5a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:25 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Volume c9b4c6d0-13d6-45e4-850b-06a423857e73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b4c6d0-13d6-45e4-850b-06a423857e73', 'volume_size': 1} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-672934312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b4c6d0-13d6-45e4-850b-06a423857e73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c1341c8f01475682c83dcda506764c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:52:25Z,use_quota=True,user_id='77a1f58fc24e4f72ad3bb81b6a6548b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Creating volume c9b4c6d0-13d6-45e4-850b-06a423857e73 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:52:25 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:52:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:25 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 1073741824 Jun 19 23:52:25 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:26 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 1073741824" returned: 0 in 1.519s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:27 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 Jun 19 23:52:27 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:27 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:52:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:52:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:52:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:28 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:52:28 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:28 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73" returned: 0 in 1.104s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] <== create_volume: return (2735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.743s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8bd542-cd64-461a-8b0a-e9153cca5a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b4c6d0-13d6-45e4-850b-06a423857e73', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9f6542-de39-4927-abfc-b47262bf2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:52:28 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Volume volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 (c9b4c6d0-13d6-45e4-850b-06a423857e73): created successfully Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9f6542-de39-4927-abfc-b47262bf2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:52:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Flow 'volume_create_manager' (ea21c469-c83d-4be3-9a15-7f0fe061fa68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:52:28 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-83dd4a97-9bec-46b8-bdb0-ea729d51832d tempest-VolumesAdminNegativeTest-1045392332 None] Created volume successfully. Jun 19 23:52:29 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.582s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 6 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Acquiring lock "cinder-c9b4c6d0-13d6-45e4-850b-06a423857e73-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Lock "cinder-c9b4c6d0-13d6-45e4-850b-06a423857e73-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Acquiring lock "cinder-quobyte-c9b4c6d0-13d6-45e4-850b-06a423857e73" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:52:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Lock "cinder-quobyte-c9b4c6d0-13d6-45e4-850b-06a423857e73" acquired by "delete_volume" :: waited 0.049s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:52:29 devstack cinder-volume[93391]: INFO oslo.privsep.daemon [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphjhl55ev/privsep.sock'] Jun 19 23:52:29 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphjhl55ev/privsep.sock Jun 19 23:52:29 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 19 23:52:31 devstack cinder-volume[93391]: WARNING py.warnings [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 19 23:52:31 devstack cinder-volume[93391]: .first() Jun 19 23:52:31 devstack cinder-volume[93391]: Jun 19 23:52:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:52:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 23:52:32 devstack cinder-volume[93391]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 19 23:52:33 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:33 devstack cinder-volume[93391]: INFO oslo.privsep.daemon [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Spawned new privsep daemon via rootwrap Jun 19 23:52:33 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Accepted privsep connection to /tmp/tmphjhl55ev/privsep.sock {{(pid=93391) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 19 23:52:33 devstack cinder-volume[93391]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 19 23:52:33 devstack cinder-volume[93391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 19 23:52:33 devstack cinder-volume[93391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 19 23:52:33 devstack cinder-volume[93391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94670 Jun 19 23:52:33 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e49604-d541-46bf-8d03-c645a076d31d]: (2,) {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:52:33 devstack cinder-volume[93391]: WARNING oslo_privsep.priv_context [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] privsep daemon already running Jun 19 23:52:33 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1176d723-c4c1-479b-a918-4134303a7e37]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:52:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:33 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9efaa-dc3f-41cf-a85c-e05436f35824]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:52:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:33 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f Jun 19 23:52:33 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:33 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 Jun 19 23:52:33 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:35 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f" returned: 0 in 1.850s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.637s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:52:35 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73" returned: 0 in 1.853s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:35 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73 Jun 19 23:52:35 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fd01cb4-c793-4d2c-afb2-fd93b2e03fbb', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 23:52:35 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-fc006ad2-1311-494f-a70e-d472f2bb88a2 req-7585ebef-af38-4570-8655-a8727fe9f7b3 tempest-DeleteServersTestJSON-897734001 None] attachment_update completed successfully. Jun 19 23:52:37 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9b4c6d0-13d6-45e4-850b-06a423857e73" returned: 0 in 1.817s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Lock "cinder-quobyte-c9b4c6d0-13d6-45e4-850b-06a423857e73" released by "delete_volume" :: held 7.164s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:52:37 devstack cinder-volume[93391]: WARNING cinder.quota [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:52:37 devstack cinder-volume[93391]: WARNING cinder.quota [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Created reservations ['bce16e63-fa06-4d0f-b711-ab97c1e34745', 'a1cd9a0d-559f-4e48-ba93-e88e3a7a7c7f', 'e009c61b-8e48-4578-ac76-959872e0d5ff', '2d63916d-4a2a-4c3c-9f7f-4a6f2a3b4f21'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:52:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:37 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:52:37 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:38 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.357s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:38 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:52:38 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Deleted volume successfully. Jun 19 23:52:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9e999dc5-8c98-4204-af6f-2afa0707fd72 tempest-VolumesAdminNegativeTest-1045392332 None] Lock "cinder-c9b4c6d0-13d6-45e4-850b-06a423857e73-delete_volume" released by "delete_volume" :: held 9.018s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:52:47 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:52:47 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-34647be6-d7d3-4302-9b1b-8dac9ed01081 req-e33f0c0c-65a2-4375-b58e-8c8a2956b9c3 tempest-DeleteServersTestJSON-897734001 None] Terminate volume connection completed successfully. Jun 19 23:52:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-34647be6-d7d3-4302-9b1b-8dac9ed01081 req-e33f0c0c-65a2-4375-b58e-8c8a2956b9c3 tempest-DeleteServersTestJSON-897734001 None] Deleting attachment 1fd01cb4-c793-4d2c-afb2-fd93b2e03fbb. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:52:48 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=13,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=3 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:52:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Acquiring lock "cinder-fd824116-7f57-4d9d-9ecc-1e021bcc062f-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:52:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Lock "cinder-fd824116-7f57-4d9d-9ecc-1e021bcc062f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:52:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Acquiring lock "cinder-quobyte-fd824116-7f57-4d9d-9ecc-1e021bcc062f" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:52:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Lock "cinder-quobyte-fd824116-7f57-4d9d-9ecc-1e021bcc062f" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:52:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab82d1d-2923-4cd6-9d7b-71e910f23998]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:52:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:51 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f Jun 19 23:52:51 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:52 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f" returned: 0 in 0.870s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:52 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f Jun 19 23:52:52 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:53 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fd824116-7f57-4d9d-9ecc-1e021bcc062f" returned: 0 in 0.756s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Lock "cinder-quobyte-fd824116-7f57-4d9d-9ecc-1e021bcc062f" released by "delete_volume" :: held 1.685s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Created reservations ['a71cd7c5-67ab-4848-a434-638612714889', '24a483ba-fe18-45db-af74-8f4587181f29', '6091368e-4d3a-45ef-9f50-6966e52b0b9e', 'db9eb735-e3ec-495a-820e-c4890d556329'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:52:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:52:53 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:52:53 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:52:54 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jun 19 23:52:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.813s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:52:54 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:52:54 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Deleted volume successfully. Jun 19 23:52:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-651013f6-2d86-4e10-83ec-25de12503838 tempest-DeleteServersTestJSON-897734001 None] Lock "cinder-fd824116-7f57-4d9d-9ecc-1e021bcc062f-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Flow 'volume_create_manager' (650ab980-924a-40a2-ae45-5fb92ccc85cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58057858-3d28-4ee2-b908-c6b759d9566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58057858-3d28-4ee2-b908-c6b759d9566e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1482501513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6209574e-1c9d-4304-b47a-3285e51b3381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb45372cddd4e48a91d5df075c3c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:53:02Z,use_quota=True,user_id='68be8f129bfc4789b6b90e45c30d8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275e8a50-79e1-4ee6-aec1-0b630a964434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275e8a50-79e1-4ee6-aec1-0b630a964434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93997145-07bc-4019-bdff-67349020bd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93997145-07bc-4019-bdff-67349020bd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6209574e-1c9d-4304-b47a-3285e51b3381', 'volume_name': 'volume-6209574e-1c9d-4304-b47a-3285e51b3381', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714a7b71-1864-4c64-aaac-2669cd03f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714a7b71-1864-4c64-aaac-2669cd03f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e245cd-3d11-42c2-a84c-f93b77f69407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:01 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Volume 6209574e-1c9d-4304-b47a-3285e51b3381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6209574e-1c9d-4304-b47a-3285e51b3381', 'volume_size': 1} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1482501513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6209574e-1c9d-4304-b47a-3285e51b3381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb45372cddd4e48a91d5df075c3c336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:53:02Z,use_quota=True,user_id='68be8f129bfc4789b6b90e45c30d8f72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Creating volume 6209574e-1c9d-4304-b47a-3285e51b3381 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:53:01 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:53:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:53:01 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 1073741824 Jun 19 23:53:01 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:53:03 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 1073741824" returned: 0 in 1.199s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:53:03 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 Jun 19 23:53:03 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:53:03 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381" returned: 0 in 0.783s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e245cd-3d11-42c2-a84c-f93b77f69407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6209574e-1c9d-4304-b47a-3285e51b3381', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16def2d6-9b89-4029-b544-e528b9657b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:03 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Volume volume-6209574e-1c9d-4304-b47a-3285e51b3381 (6209574e-1c9d-4304-b47a-3285e51b3381): created successfully Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16def2d6-9b89-4029-b544-e528b9657b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Flow 'volume_create_manager' (650ab980-924a-40a2-ae45-5fb92ccc85cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:53:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3a358915-b2d6-4802-a000-eb4fc8b58c77 tempest-ServerActionsTestOtherA-674621705 None] Created volume successfully. Jun 19 23:53:15 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:53:15 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=2 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Flow 'volume_create_manager' (45fef7fe-e6ac-42b5-9157-b836c5dc6592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cd5914-837c-48b5-870b-b18197731cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cd5914-837c-48b5-870b-b18197731cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-623205831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db67034e-5620-4785-ad2a-f316ba3bacba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc083a5783c64d62bd2dd18cbc962889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:53:19Z,use_quota=True,user_id='cd76aff7d1ee4ba9a41ca1f541cf5c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc718ac-33e7-41f3-996e-41554b4775a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc718ac-33e7-41f3-996e-41554b4775a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02745b3c-e165-41aa-8ded-e1da74e696f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02745b3c-e165-41aa-8ded-e1da74e696f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db67034e-5620-4785-ad2a-f316ba3bacba', 'volume_name': 'volume-db67034e-5620-4785-ad2a-f316ba3bacba', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e7fe1c-6bd3-474f-b474-3228a5510937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e7fe1c-6bd3-474f-b474-3228a5510937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7250910-b531-4bab-a669-14b919e44e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:19 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Volume db67034e-5620-4785-ad2a-f316ba3bacba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db67034e-5620-4785-ad2a-f316ba3bacba', 'volume_size': 1} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-623205831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db67034e-5620-4785-ad2a-f316ba3bacba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc083a5783c64d62bd2dd18cbc962889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:53:19Z,use_quota=True,user_id='cd76aff7d1ee4ba9a41ca1f541cf5c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Creating volume db67034e-5620-4785-ad2a-f316ba3bacba {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:53:19 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:53:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:53:19 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba 1073741824 Jun 19 23:53:19 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:53:20 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jun 19 23:53:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba 1073741824" returned: 0 in 1.118s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:53:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:53:20 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba Jun 19 23:53:20 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:53:21 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jun 19 23:53:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba" returned: 0 in 0.843s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:53:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:53:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:53:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7250910-b531-4bab-a669-14b919e44e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db67034e-5620-4785-ad2a-f316ba3bacba', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09de28df-383a-4b2d-ab04-230a17ad7d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:53:21 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Volume volume-db67034e-5620-4785-ad2a-f316ba3bacba (db67034e-5620-4785-ad2a-f316ba3bacba): created successfully Jun 19 23:53:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09de28df-383a-4b2d-ab04-230a17ad7d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:53:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Flow 'volume_create_manager' (45fef7fe-e6ac-42b5-9157-b836c5dc6592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:53:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ba8c2549-750c-4133-862e-917e2640d354 tempest-TaggedAttachmentsTest-12257578 None] Created volume successfully. Jun 19 23:53:27 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:53:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:53:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:53:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:53:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:53:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:53:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:53:28 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:53:28 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:53:28 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Jun 19 23:53:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.888s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:53:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:53:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:53:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 8 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:53:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:53:31 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:53:31 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Flow 'volume_create_manager' (a05a8633-0bea-45f5-b779-3c6fe24ba024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597f433a-fe40-4078-a0cf-09fa84bc8e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597f433a-fe40-4078-a0cf-09fa84bc8e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1755774502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de81cd6d-bfe3-46bd-b4c5-b833a5206a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f470800e61504acd8adecb4720963b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:54:06Z,use_quota=True,user_id='a87479c9f0f94f47ae52e936e386a804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceee271c-1921-4907-8775-539f613780de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceee271c-1921-4907-8775-539f613780de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1850d575-c5bd-4c9d-bc00-03f6bea1c09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1850d575-c5bd-4c9d-bc00-03f6bea1c09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de81cd6d-bfe3-46bd-b4c5-b833a5206a81', 'volume_name': 'volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92307030-7953-4c9a-93a7-2dfbf7f15d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92307030-7953-4c9a-93a7-2dfbf7f15d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd1029d-6e40-433b-8858-9690d312df33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:06 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Volume de81cd6d-bfe3-46bd-b4c5-b833a5206a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81', 'volume_size': 1} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1755774502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de81cd6d-bfe3-46bd-b4c5-b833a5206a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f470800e61504acd8adecb4720963b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:54:06Z,use_quota=True,user_id='a87479c9f0f94f47ae52e936e386a804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Creating volume de81cd6d-bfe3-46bd-b4c5-b833a5206a81 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:54:06 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:54:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:06 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 1073741824 Jun 19 23:54:06 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:07 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 1073741824" returned: 0 in 0.920s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:07 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 Jun 19 23:54:07 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:08 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81" returned: 0 in 0.675s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:54:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd1029d-6e40-433b-8858-9690d312df33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7680c7-c774-4fb5-b29d-946d90d72efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:08 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Volume volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 (de81cd6d-bfe3-46bd-b4c5-b833a5206a81): created successfully Jun 19 23:54:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7680c7-c774-4fb5-b29d-946d90d72efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Flow 'volume_create_manager' (a05a8633-0bea-45f5-b779-3c6fe24ba024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:54:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1273b49a-3cb1-404d-bf6e-d5e17c36763c tempest-AttachVolumeShelveTestJSON-1067699948 None] Created volume successfully. Jun 19 23:54:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-2c619d78-2ff7-449f-a984-128eb477bab9 req-7af8fd6b-f9ed-4671-9050-193375e7dd11 tempest-ServerActionsTestOtherA-674621705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-2c619d78-2ff7-449f-a984-128eb477bab9 req-7af8fd6b-f9ed-4671-9050-193375e7dd11 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[081b63c2-9390-43e8-b0c4-e861719c525f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:54:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-2c619d78-2ff7-449f-a984-128eb477bab9 req-7af8fd6b-f9ed-4671-9050-193375e7dd11 tempest-ServerActionsTestOtherA-674621705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:09 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 Jun 19 23:54:09 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:10 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-2c619d78-2ff7-449f-a984-128eb477bab9 req-7af8fd6b-f9ed-4671-9050-193375e7dd11 tempest-ServerActionsTestOtherA-674621705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381" returned: 0 in 0.840s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-2c619d78-2ff7-449f-a984-128eb477bab9 req-7af8fd6b-f9ed-4671-9050-193375e7dd11 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-2c619d78-2ff7-449f-a984-128eb477bab9 req-7af8fd6b-f9ed-4671-9050-193375e7dd11 tempest-ServerActionsTestOtherA-674621705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-6209574e-1c9d-4304-b47a-3285e51b3381', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43e30bee-4489-4665-b26c-6a4ed8f2de63', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 23:54:10 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-2c619d78-2ff7-449f-a984-128eb477bab9 req-7af8fd6b-f9ed-4671-9050-193375e7dd11 tempest-ServerActionsTestOtherA-674621705 None] attachment_update completed successfully. Jun 19 23:54:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-0b3ce2cf-ef6a-465c-bd23-c60466224d4a tempest-ServerActionsTestOtherA-674621705 None] Terminate volume connection completed successfully. Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-0b3ce2cf-ef6a-465c-bd23-c60466224d4a tempest-ServerActionsTestOtherA-674621705 None] Deleting attachment 43e30bee-4489-4665-b26c-6a4ed8f2de63. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Flow 'volume_create_manager' (4c0488e9-1245-41b7-8b5c-dc491d321a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb06584-2568-44a4-a52d-8d67715b5afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb06584-2568-44a4-a52d-8d67715b5afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1679943317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582d638e-e8fb-466e-91c0-f3423d6a8f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b253d4b2b0554bbfab18a274159946b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:54:19Z,use_quota=True,user_id='e22e26a4d0ff45fcbe5391a840bcc24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fb49d2-a845-4105-8361-8498c104cc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fb49d2-a845-4105-8361-8498c104cc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbb41a3-5de0-40c6-a772-2c62c5a606a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbb41a3-5de0-40c6-a772-2c62c5a606a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '582d638e-e8fb-466e-91c0-f3423d6a8f0d', 'volume_name': 'volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54acda03-e2d9-4dc5-97e4-1f670d01d5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54acda03-e2d9-4dc5-97e4-1f670d01d5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bb742b-d2ba-446b-a262-109ef1f8842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:18 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Volume 582d638e-e8fb-466e-91c0-f3423d6a8f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d', 'volume_size': 1} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1679943317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582d638e-e8fb-466e-91c0-f3423d6a8f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b253d4b2b0554bbfab18a274159946b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:54:19Z,use_quota=True,user_id='e22e26a4d0ff45fcbe5391a840bcc24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Creating volume 582d638e-e8fb-466e-91c0-f3423d6a8f0d {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:54:18 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:54:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:18 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d 1073741824 Jun 19 23:54:18 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:19 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d 1073741824" returned: 0 in 0.877s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:19 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d Jun 19 23:54:19 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:20 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d" returned: 0 in 0.735s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:54:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6bb742b-d2ba-446b-a262-109ef1f8842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f4c0b6-de8d-427f-9384-aa4533f0c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:54:20 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Volume volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d (582d638e-e8fb-466e-91c0-f3423d6a8f0d): created successfully Jun 19 23:54:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f4c0b6-de8d-427f-9384-aa4533f0c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:54:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Flow 'volume_create_manager' (4c0488e9-1245-41b7-8b5c-dc491d321a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:54:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7255d111-e639-4ccf-b2df-cca17f5dc8e6 tempest-AttachVolumeNegativeTest-2045992055 None] Created volume successfully. Jun 19 23:54:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-4f8b7a4a-b1ce-4717-bda8-f5a455c39657 tempest-ServerActionsTestOtherA-674621705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-4f8b7a4a-b1ce-4717-bda8-f5a455c39657 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:21 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5a4fa-6959-4453-a3e7-a266451a91db]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:54:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-4f8b7a4a-b1ce-4717-bda8-f5a455c39657 tempest-ServerActionsTestOtherA-674621705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:21 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 Jun 19 23:54:21 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:22 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-4f8b7a4a-b1ce-4717-bda8-f5a455c39657 tempest-ServerActionsTestOtherA-674621705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381" returned: 0 in 0.816s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-4f8b7a4a-b1ce-4717-bda8-f5a455c39657 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-4f8b7a4a-b1ce-4717-bda8-f5a455c39657 tempest-ServerActionsTestOtherA-674621705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-6209574e-1c9d-4304-b47a-3285e51b3381', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5468412-ebb6-4e26-9697-c0ff139b908b', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 23:54:22 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-7c5c266d-66ca-4b4b-b784-60bfe4865344 req-4f8b7a4a-b1ce-4717-bda8-f5a455c39657 tempest-ServerActionsTestOtherA-674621705 None] attachment_update completed successfully. Jun 19 23:54:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-1b9dbc3a-7f60-4651-beef-a6dac9d09176 req-8812f1ed-a2ec-45a9-b984-bad2dc997f4d tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-1b9dbc3a-7f60-4651-beef-a6dac9d09176 req-8812f1ed-a2ec-45a9-b984-bad2dc997f4d tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:24 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dea404-8944-4957-a9b7-347bd418ebf9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:54:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-1b9dbc3a-7f60-4651-beef-a6dac9d09176 req-8812f1ed-a2ec-45a9-b984-bad2dc997f4d tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:24 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d Jun 19 23:54:24 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:25 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-1b9dbc3a-7f60-4651-beef-a6dac9d09176 req-8812f1ed-a2ec-45a9-b984-bad2dc997f4d tempest-AttachVolumeNegativeTest-2045992055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d" returned: 0 in 1.461s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-1b9dbc3a-7f60-4651-beef-a6dac9d09176 req-8812f1ed-a2ec-45a9-b984-bad2dc997f4d tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.508s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-1b9dbc3a-7f60-4651-beef-a6dac9d09176 req-8812f1ed-a2ec-45a9-b984-bad2dc997f4d tempest-AttachVolumeNegativeTest-2045992055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2f1ba4c-4c4e-4896-87a3-35ccea3257bc', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 23:54:25 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-1b9dbc3a-7f60-4651-beef-a6dac9d09176 req-8812f1ed-a2ec-45a9-b984-bad2dc997f4d tempest-AttachVolumeNegativeTest-2045992055 None] attachment_update completed successfully. Jun 19 23:54:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-fb1991d7-1301-47ba-9f5c-aee16c814947 req-095b48e3-70fa-4926-aec4-f71a296c2a01 tempest-AttachVolumeShelveTestJSON-1067699948 None] No connector for attachment b8e1acb7-f400-40e4-a7ed-8d8fe5caec56; skipping storage backend terminate_connection call. {{(pid=93391) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 19 23:54:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-fb1991d7-1301-47ba-9f5c-aee16c814947 req-095b48e3-70fa-4926-aec4-f71a296c2a01 tempest-AttachVolumeShelveTestJSON-1067699948 None] Deleting attachment b8e1acb7-f400-40e4-a7ed-8d8fe5caec56. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:54:27 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:54:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:54:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:54:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:28 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:54:28 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:28 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.737s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:54:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-6ce03d1d-adf5-4348-a357-12ae86937e9e req-a72db5f4-dacc-4c56-8433-01c3d5b42384 tempest-TaggedAttachmentsTest-12257578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:54:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-6ce03d1d-adf5-4348-a357-12ae86937e9e req-a72db5f4-dacc-4c56-8433-01c3d5b42384 tempest-TaggedAttachmentsTest-12257578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:54:30 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0206c519-a5a7-4adb-9ddf-c4bb4ee2d907]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:54:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-6ce03d1d-adf5-4348-a357-12ae86937e9e req-a72db5f4-dacc-4c56-8433-01c3d5b42384 tempest-TaggedAttachmentsTest-12257578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:54:31 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba Jun 19 23:54:31 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:54:32 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jun 19 23:54:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-6ce03d1d-adf5-4348-a357-12ae86937e9e req-a72db5f4-dacc-4c56-8433-01c3d5b42384 tempest-TaggedAttachmentsTest-12257578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba" returned: 0 in 1.219s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:54:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-6ce03d1d-adf5-4348-a357-12ae86937e9e req-a72db5f4-dacc-4c56-8433-01c3d5b42384 tempest-TaggedAttachmentsTest-12257578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.242s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:54:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-6ce03d1d-adf5-4348-a357-12ae86937e9e req-a72db5f4-dacc-4c56-8433-01c3d5b42384 tempest-TaggedAttachmentsTest-12257578 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-db67034e-5620-4785-ad2a-f316ba3bacba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed722f7e-1608-4d14-af12-40094417dcbd', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 23:54:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-6ce03d1d-adf5-4348-a357-12ae86937e9e req-a72db5f4-dacc-4c56-8433-01c3d5b42384 tempest-TaggedAttachmentsTest-12257578 None] attachment_update completed successfully. Jun 19 23:54:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-a643ad98-051f-4894-bd33-903648904f5f req-93db449b-7cc9-4030-86f3-2e47550b77a7 tempest-TaggedAttachmentsTest-12257578 None] Terminate volume connection completed successfully. Jun 19 23:54:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-a643ad98-051f-4894-bd33-903648904f5f req-93db449b-7cc9-4030-86f3-2e47550b77a7 tempest-TaggedAttachmentsTest-12257578 None] Deleting attachment ed722f7e-1608-4d14-af12-40094417dcbd. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:54:50 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=30,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:54:50 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=11,cinder:SELECT=28,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:54:55 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-151d49c6-d1da-4cbc-b421-e48376bf51cb req-e95c4368-4e22-442a-a0d5-70d334f1dd79 tempest-ServerActionsTestOtherA-674621705 None] Terminate volume connection completed successfully. Jun 19 23:54:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-151d49c6-d1da-4cbc-b421-e48376bf51cb req-e95c4368-4e22-442a-a0d5-70d334f1dd79 tempest-ServerActionsTestOtherA-674621705 None] Deleting attachment a5468412-ebb6-4e26-9697-c0ff139b908b. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:55:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Acquiring lock "cinder-db67034e-5620-4785-ad2a-f316ba3bacba-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Lock "cinder-db67034e-5620-4785-ad2a-f316ba3bacba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Acquiring lock "cinder-quobyte-db67034e-5620-4785-ad2a-f316ba3bacba" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Lock "cinder-quobyte-db67034e-5620-4785-ad2a-f316ba3bacba" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23396a5-021d-4979-9f18-00170abfdb09]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:55:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:03 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba Jun 19 23:55:03 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:03 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba" returned: 0 in 0.838s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:03 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba Jun 19 23:55:03 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:04 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-db67034e-5620-4785-ad2a-f316ba3bacba" returned: 0 in 0.709s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Lock "cinder-quobyte-db67034e-5620-4785-ad2a-f316ba3bacba" released by "delete_volume" :: held 1.611s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Created reservations ['7c439f7b-7aae-476f-b1e4-d4f48b4626ea', 'b5a7088a-52bc-4180-9491-202bf4bf5f26', '37978e12-0e4c-42be-b98a-6b7d0f2e88b6', 'fdc8a9c0-7db9-4ba6-95ce-7954af06de94'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:55:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:04 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:55:04 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:05 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.661s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:05 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:55:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Deleted volume successfully. Jun 19 23:55:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6873bdef-273b-4f7e-b99c-d6263b64634f tempest-TaggedAttachmentsTest-12257578 None] Lock "cinder-db67034e-5620-4785-ad2a-f316ba3bacba-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Acquiring lock "cinder-6209574e-1c9d-4304-b47a-3285e51b3381-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Lock "cinder-6209574e-1c9d-4304-b47a-3285e51b3381-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Acquiring lock "cinder-quobyte-6209574e-1c9d-4304-b47a-3285e51b3381" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Lock "cinder-quobyte-6209574e-1c9d-4304-b47a-3285e51b3381" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dc9ede-17fc-4fdf-8c7d-2247039e1804]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:55:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:07 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 Jun 19 23:55:07 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:07 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381" returned: 0 in 0.801s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:07 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381 Jun 19 23:55:07 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:08 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6209574e-1c9d-4304-b47a-3285e51b3381" returned: 0 in 0.811s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Lock "cinder-quobyte-6209574e-1c9d-4304-b47a-3285e51b3381" released by "delete_volume" :: held 1.661s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Created reservations ['d05c9b97-4050-49fa-8fb2-95d5a85f360d', '69ade365-0617-425b-a00c-17ee6ac7b90d', '9825a420-068c-49f8-9bf7-3721837741a3', '6005b1e2-1ffe-40c0-8f95-3b89ec8bfa48'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:55:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:08 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:55:08 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:09 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.796s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:09 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:55:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Deleted volume successfully. Jun 19 23:55:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-589326c3-9cf6-4c81-84f7-fae0223f0c49 tempest-ServerActionsTestOtherA-674621705 None] Lock "cinder-6209574e-1c9d-4304-b47a-3285e51b3381-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:18 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:55:19 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:55:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Acquiring lock "cinder-de81cd6d-bfe3-46bd-b4c5-b833a5206a81-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "cinder-de81cd6d-bfe3-46bd-b4c5-b833a5206a81-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Acquiring lock "cinder-quobyte-de81cd6d-bfe3-46bd-b4c5-b833a5206a81" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "cinder-quobyte-de81cd6d-bfe3-46bd-b4c5-b833a5206a81" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:23 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05357163-a70d-4caa-b2b5-766ac00f9dd0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:55:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:23 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 Jun 19 23:55:23 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:24 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81" returned: 0 in 1.198s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:24 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81 Jun 19 23:55:24 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:25 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-de81cd6d-bfe3-46bd-b4c5-b833a5206a81" returned: 0 in 0.845s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "cinder-quobyte-de81cd6d-bfe3-46bd-b4c5-b833a5206a81" released by "delete_volume" :: held 2.105s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Created reservations ['0eae341d-7f85-4e56-9d82-a5092e728932', 'e5915a31-9c79-4f05-b36d-e1bdbd0394c5', 'b9666fac-1ea9-44b1-8576-4b80fccfdf81', '844d24be-1276-4f0c-ab63-62a4a1ed77f9'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:55:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:25 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:55:25 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:26 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.723s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:26 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:55:26 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Deleted volume successfully. Jun 19 23:55:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d02cadd6-36f8-4c48-aabd-51d07c67cf2a tempest-AttachVolumeShelveTestJSON-1067699948 None] Lock "cinder-de81cd6d-bfe3-46bd-b4c5-b833a5206a81-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-25a0dfee-10fe-41f1-96d5-70ea7b8a78d7 req-87a98a42-6b45-4419-86b5-c00e15dc5e6e tempest-AttachVolumeNegativeTest-2045992055 None] Terminate volume connection completed successfully. Jun 19 23:55:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-25a0dfee-10fe-41f1-96d5-70ea7b8a78d7 req-87a98a42-6b45-4419-86b5-c00e15dc5e6e tempest-AttachVolumeNegativeTest-2045992055 None] Deleting attachment b2f1ba4c-4c4e-4896-87a3-35ccea3257bc. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:28 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:55:28 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:28 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.731s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 8 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:55:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Flow 'volume_create_manager' (363715de-2b43-412c-9e9c-71e953d8fd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86b9f0e-271f-4fd6-80ed-e885331c20bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86b9f0e-271f-4fd6-80ed-e885331c20bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-732396597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad5f840-fd19-45cf-899a-90f78242959a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7703f95032bf4caab8f3682610c76134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:55:38Z,use_quota=True,user_id='179abc48ebd7469b8f02c5b3c434f3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94709e60-464e-49f4-ab8c-d7906fab37e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94709e60-464e-49f4-ab8c-d7906fab37e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0712ae-dcca-46f2-92c7-252a8bc7a166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0712ae-dcca-46f2-92c7-252a8bc7a166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad5f840-fd19-45cf-899a-90f78242959a', 'volume_name': 'volume-4ad5f840-fd19-45cf-899a-90f78242959a', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2643bdc1-c0c5-4d3a-878f-806a62ff9855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2643bdc1-c0c5-4d3a-878f-806a62ff9855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba42cd56-d2e1-4240-bf78-3e08aee24e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:55:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Volume 4ad5f840-fd19-45cf-899a-90f78242959a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad5f840-fd19-45cf-899a-90f78242959a', 'volume_size': 1} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-732396597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad5f840-fd19-45cf-899a-90f78242959a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7703f95032bf4caab8f3682610c76134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:55:38Z,use_quota=True,user_id='179abc48ebd7469b8f02c5b3c434f3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Creating volume 4ad5f840-fd19-45cf-899a-90f78242959a {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:55:37 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:55:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:37 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a 1073741824 Jun 19 23:55:37 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:38 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a 1073741824" returned: 0 in 1.069s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:39 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a Jun 19 23:55:39 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:39 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a" returned: 0 in 0.838s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:55:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:55:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba42cd56-d2e1-4240-bf78-3e08aee24e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad5f840-fd19-45cf-899a-90f78242959a', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:55:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92f8bb1-3ceb-4f1e-a15b-d2d18182b342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:55:39 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Volume volume-4ad5f840-fd19-45cf-899a-90f78242959a (4ad5f840-fd19-45cf-899a-90f78242959a): created successfully Jun 19 23:55:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92f8bb1-3ceb-4f1e-a15b-d2d18182b342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:55:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Flow 'volume_create_manager' (363715de-2b43-412c-9e9c-71e953d8fd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:55:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-bc314eb6-a26a-4baa-84d1-047cb989d7cf req-7958cd2c-b1c5-42d2-9c6d-7caa01180620 tempest-VolumesSnapshotsTestJSON-625918728 None] Created volume successfully. Jun 19 23:55:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:55:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:55:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Creating offline snapshot 7bb97534-afd9-49b7-818b-367ddd705b86 of volume 4ad5f840-fd19-45cf-899a-90f78242959a {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 23:55:40 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[79293513-986a-4833-bbb5-599ddec00583]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:55:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:40 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a Jun 19 23:55:40 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:41 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a" returned: 0 in 1.007s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:41 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 1G Jun 19 23:55:41 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:42 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 1G" returned: 0 in 1.091s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad5f840-fd19-45cf-899a-90f78242959a -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:42 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad5f840-fd19-45cf-899a-90f78242959a -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 Jun 19 23:55:42 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:43 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ad5f840-fd19-45cf-899a-90f78242959a -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86" returned: 0 in 0.982s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:43 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 is being set with open permissions: ugo+rw Jun 19 23:55:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:43 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 Jun 19 23:55:43 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:44 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86" returned: 0 in 0.962s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:44 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.info Jun 19 23:55:44 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:45 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.info" returned: 0 in 0.951s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:45 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.info is being set with open permissions: ugo+rw Jun 19 23:55:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:45 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.info Jun 19 23:55:45 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:46 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.info" returned: 0 in 0.939s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.079s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:55:46 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-5779c52c-d318-4580-8a4d-c01a81ca4f02 req-c37c9eb5-552f-4bfc-996c-6f848bb8920d tempest-VolumesSnapshotsTestJSON-625918728 None] Create snapshot completed successfully Jun 19 23:55:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "cinder-7bb97534-afd9-49b7-818b-367ddd705b86-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-7bb97534-afd9-49b7-818b-367ddd705b86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "cinder-quobyte-4ad5f840-fd19-45cf-899a-90f78242959a" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-quobyte-4ad5f840-fd19-45cf-899a-90f78242959a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "cinder-quobyte-7bb97534-afd9-49b7-818b-367ddd705b86" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-quobyte-7bb97534-afd9-49b7-818b-367ddd705b86" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Deleting offline snapshot 7bb97534-afd9-49b7-818b-367ddd705b86 of volume 4ad5f840-fd19-45cf-899a-90f78242959a {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] snapshot_file for this snap is: volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff0b1d6-549c-4913-8593-37f3b674ce47]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:47 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 Jun 19 23:55:47 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:47 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86" returned: 0 in 0.896s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ad5f840-fd19-45cf-899a-90f78242959a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:55:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cab03f-c98c-4aae-9a28-5b6bf95161ab]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:55:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:48 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a Jun 19 23:55:48 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:48 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a" returned: 0 in 0.810s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:48 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 Jun 19 23:55:48 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:49 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86" returned: 0 in 0.826s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:49 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86 Jun 19 23:55:49 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:50 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a.7bb97534-afd9-49b7-818b-367ddd705b86" returned: 0 in 0.791s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-quobyte-7bb97534-afd9-49b7-818b-367ddd705b86" released by "_delete_snapshot" :: held 3.486s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-quobyte-4ad5f840-fd19-45cf-899a-90f78242959a" released by "delete_snapshot" :: held 3.527s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:50 devstack cinder-volume[93391]: WARNING cinder.quota [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:55:50 devstack cinder-volume[93391]: DEBUG cinder.quota [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Created reservations ['1b8459de-d996-43f7-9087-7989eeabe93a', 'af9429fb-a526-4a03-979f-39bb3a4233e1', '324f9bec-ab95-4cb4-ad85-ce3fd2b163e8', 'd35eb965-2b44-48ac-b58d-5789f11ac690'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:55:50 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Delete snapshot completed successfully. Jun 19 23:55:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-614ae2e4-a20e-414e-9724-6d288c4bd948 req-239d4027-4351-4ec9-a4f3-0e8f1fda53b6 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-7bb97534-afd9-49b7-818b-367ddd705b86-delete_snapshot" released by "delete_snapshot" :: held 3.762s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "cinder-4ad5f840-fd19-45cf-899a-90f78242959a-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-4ad5f840-fd19-45cf-899a-90f78242959a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "cinder-quobyte-4ad5f840-fd19-45cf-899a-90f78242959a" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:55:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-quobyte-4ad5f840-fd19-45cf-899a-90f78242959a" acquired by "delete_volume" :: waited 0.039s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:55:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[603baab4-0b1f-450b-ac1a-3a351d5a9564]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:55:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:51 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a Jun 19 23:55:51 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:53 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a" returned: 0 in 1.484s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:53 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a Jun 19 23:55:53 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:54 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ad5f840-fd19-45cf-899a-90f78242959a" returned: 0 in 1.675s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-quobyte-4ad5f840-fd19-45cf-899a-90f78242959a" released by "delete_volume" :: held 3.295s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:55:55 devstack cinder-volume[93391]: DEBUG cinder.quota [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Created reservations ['aa0cfaa7-ee27-4ebc-9aa6-125bbd23cf17', '1ec28a91-24ae-4329-baaa-74563f10401f', 'eff098bd-e6f6-4fea-9c65-03aa26f68709', '7560f33d-3522-4ea4-bb46-2a4f4a7197c9'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:55:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:55:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:55:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:55:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:55:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:55:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:55:55 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:55:55 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:55:56 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jun 19 23:55:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.354s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:55:56 devstack cinder-volume[93391]: DEBUG cinder.manager [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:55:56 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Deleted volume successfully. Jun 19 23:55:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-3c18819b-a118-49ed-a067-ea1dc55ebf2e req-910c5709-f8db-473a-9c63-35d4bf00d0a1 tempest-VolumesSnapshotsTestJSON-625918728 None] Lock "cinder-4ad5f840-fd19-45cf-899a-90f78242959a-delete_volume" released by "delete_volume" :: held 5.095s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Flow 'volume_create_manager' (625ca0f8-8472-4395-9dfd-d8ae87d8e319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d4a7ad-0140-458c-b694-33ee2cfce1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d4a7ad-0140-458c-b694-33ee2cfce1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-18415786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02436d8-7bdd-4c88-816f-80d4a406333a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='023cbb3217804c39b40da18a4550d1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:05Z,use_quota=True,user_id='ac87c584b5034beab3f06c480de2ac57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542b161b-e587-4d88-bc67-3ae67df9d13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542b161b-e587-4d88-bc67-3ae67df9d13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed4f6a0-dae3-486f-8077-8d24d7367fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed4f6a0-dae3-486f-8077-8d24d7367fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02436d8-7bdd-4c88-816f-80d4a406333a', 'volume_name': 'volume-f02436d8-7bdd-4c88-816f-80d4a406333a', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9294f0-d7f6-463e-a9df-656e5d2b9df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9294f0-d7f6-463e-a9df-656e5d2b9df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a9d17-9756-4b20-85bb-6f064d72cd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:05 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Volume f02436d8-7bdd-4c88-816f-80d4a406333a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02436d8-7bdd-4c88-816f-80d4a406333a', 'volume_size': 1} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-18415786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02436d8-7bdd-4c88-816f-80d4a406333a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='023cbb3217804c39b40da18a4550d1c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:05Z,use_quota=True,user_id='ac87c584b5034beab3f06c480de2ac57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Creating volume f02436d8-7bdd-4c88-816f-80d4a406333a {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:56:05 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:56:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:05 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a 1073741824 Jun 19 23:56:05 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:08 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a 1073741824" returned: 0 in 3.223s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:08 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a Jun 19 23:56:08 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:11 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a" returned: 0 in 2.438s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] <== create_volume: return (5770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:56:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.772s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a9d17-9756-4b20-85bb-6f064d72cd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02436d8-7bdd-4c88-816f-80d4a406333a', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002ba5bd-6d01-47c3-9790-6d10dd3e5a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:11 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Volume volume-f02436d8-7bdd-4c88-816f-80d4a406333a (f02436d8-7bdd-4c88-816f-80d4a406333a): created successfully Jun 19 23:56:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002ba5bd-6d01-47c3-9790-6d10dd3e5a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Flow 'volume_create_manager' (625ca0f8-8472-4395-9dfd-d8ae87d8e319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:11 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-5ff17cb2-649e-4509-a3b2-91f5d09fc1b9 req-ed14013b-7549-4503-a40a-e3575616f8d7 tempest-VolumesGetTestJSON-1740231275 None] Created volume successfully. Jun 19 23:56:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Acquiring lock "cinder-f02436d8-7bdd-4c88-816f-80d4a406333a-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Lock "cinder-f02436d8-7bdd-4c88-816f-80d4a406333a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Acquiring lock "cinder-quobyte-f02436d8-7bdd-4c88-816f-80d4a406333a" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Lock "cinder-quobyte-f02436d8-7bdd-4c88-816f-80d4a406333a" acquired by "delete_volume" :: waited 0.040s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:15 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad895dc7-d04d-4aa5-b05a-83635cdc3adc]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:56:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:15 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a Jun 19 23:56:15 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:17 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a" returned: 0 in 2.120s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:17 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a Jun 19 23:56:17 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:18 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f02436d8-7bdd-4c88-816f-80d4a406333a" returned: 0 in 1.339s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Lock "cinder-quobyte-f02436d8-7bdd-4c88-816f-80d4a406333a" released by "delete_volume" :: held 3.591s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:19 devstack cinder-volume[93391]: DEBUG cinder.quota [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Created reservations ['dd141940-2ca3-4410-9e33-7e3dcdedb964', 'b96aee06-c59e-408d-8efc-9ba367e3e553', '24ce32a8-ef20-478b-89bd-255b531b14e5', '10972787-ffde-4bbb-a37d-9957e9913c6e'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:56:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:19 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:56:19 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:20 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.621s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:21 devstack cinder-volume[93391]: DEBUG cinder.manager [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:56:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Deleted volume successfully. Jun 19 23:56:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-ac10a107-8365-4052-ba35-fd7f8b5494de req-9d186a48-b33f-4c21-996b-a6b2cddbae58 tempest-VolumesGetTestJSON-1740231275 None] Lock "cinder-f02436d8-7bdd-4c88-816f-80d4a406333a-delete_volume" released by "delete_volume" :: held 5.902s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:27 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:56:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:28 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:56:28 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:29 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:56:30 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 2.006s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:30 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:56:30 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8727aa56-8253-44f2-9826-3acee76d027e tempest-GroupSnapshotsV319Test-71681530 None] Group tempest-GroupSnapshotsV319Test-Group-836957750: creating Jun 19 23:56:30 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:56:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 8 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:56:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:56:30 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8727aa56-8253-44f2-9826-3acee76d027e tempest-GroupSnapshotsV319Test-71681530 None] Group tempest-GroupSnapshotsV319Test-Group-836957750: created successfully Jun 19 23:56:30 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8727aa56-8253-44f2-9826-3acee76d027e tempest-GroupSnapshotsV319Test-71681530 None] Create group completed successfully. Jun 19 23:56:31 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:56:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Flow 'volume_create_manager' (8cb3b127-3839-4698-99af-cbbb6d570971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e02b789-bf73-44e7-9d7b-60969e668267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e02b789-bf73-44e7-9d7b-60969e668267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1889598472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d98a53ac-3268-412a-b830-44af50dcb8b7,host='devstack@QuobyteHD#QuobyteHD',id=2f11a022-3ef5-4c1f-b72d-e59130484479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e78a4c7e5e48958a5cd4ceee5f6616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:32Z,use_quota=True,user_id='cff0bc0dd3494221809cb68388029a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dda59bd7-f549-4bc9-a445-9c38ebdcfcc2),volume_type_id=dda59bd7-f549-4bc9-a445-9c38ebdcfcc2)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59601f46-1165-4e34-b74d-8a257d9e3f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59601f46-1165-4e34-b74d-8a257d9e3f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc8f687-65ed-4e3a-9c45-d09e6527e3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc8f687-65ed-4e3a-9c45-d09e6527e3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f11a022-3ef5-4c1f-b72d-e59130484479', 'volume_name': 'volume-2f11a022-3ef5-4c1f-b72d-e59130484479', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6e1003-22c4-4863-8250-9ee7a1b8b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6e1003-22c4-4863-8250-9ee7a1b8b112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3136d24c-7ed3-4bea-953e-515f28d6e72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:32 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Volume 2f11a022-3ef5-4c1f-b72d-e59130484479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f11a022-3ef5-4c1f-b72d-e59130484479', 'volume_size': 1} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d98a53ac-3268-412a-b830-44af50dcb8b7,created_at=2026-06-19T21:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1889598472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d98a53ac-3268-412a-b830-44af50dcb8b7,host='devstack@QuobyteHD#QuobyteHD',id=2f11a022-3ef5-4c1f-b72d-e59130484479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9e78a4c7e5e48958a5cd4ceee5f6616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:32Z,use_quota=True,user_id='cff0bc0dd3494221809cb68388029a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dda59bd7-f549-4bc9-a445-9c38ebdcfcc2),volume_type_id=dda59bd7-f549-4bc9-a445-9c38ebdcfcc2)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Creating volume 2f11a022-3ef5-4c1f-b72d-e59130484479 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:56:32 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:56:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:32 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 1073741824 Jun 19 23:56:32 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:33 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 1073741824" returned: 0 in 0.956s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:33 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 Jun 19 23:56:33 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Flow 'volume_create_manager' (ef1bfa21-bf61-4c2d-b335-b1f2384c986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6299353-f44c-420b-b285-33a247582bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6299353-f44c-420b-b285-33a247582bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1289652858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cf08b6-4796-4f23-b5cf-720dfc8f9ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64df1379f88445aa267a8a5fa5c9c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:34Z,use_quota=True,user_id='2ebc70c034724365bfe30e63c8a165f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa078a18-2a31-4a7c-9746-faf987f2562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa078a18-2a31-4a7c-9746-faf987f2562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0758b2e0-72f7-4c3b-9a42-be4615edbf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0758b2e0-72f7-4c3b-9a42-be4615edbf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cf08b6-4796-4f23-b5cf-720dfc8f9ace', 'volume_name': 'volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96da610e-f7cc-405d-b54f-db9ccbce8dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:34 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96da610e-f7cc-405d-b54f-db9ccbce8dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f334c332-63b1-4192-8b4b-0214df4a69a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:34 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Volume 41cf08b6-4796-4f23-b5cf-720dfc8f9ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace', 'volume_size': 1} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479" returned: 0 in 0.931s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1289652858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cf08b6-4796-4f23-b5cf-720dfc8f9ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64df1379f88445aa267a8a5fa5c9c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:34Z,use_quota=True,user_id='2ebc70c034724365bfe30e63c8a165f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Creating volume 41cf08b6-4796-4f23-b5cf-720dfc8f9ace {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:56:34 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:34 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace 1073741824 Jun 19 23:56:34 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3136d24c-7ed3-4bea-953e-515f28d6e72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f11a022-3ef5-4c1f-b72d-e59130484479', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220e023c-8b0a-44db-9575-5e65c13dcbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:34 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Volume volume-2f11a022-3ef5-4c1f-b72d-e59130484479 (2f11a022-3ef5-4c1f-b72d-e59130484479): created successfully Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (220e023c-8b0a-44db-9575-5e65c13dcbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Flow 'volume_create_manager' (8cb3b127-3839-4698-99af-cbbb6d570971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b836b18a-ee1f-4b83-a465-6402c0470c9d tempest-GroupSnapshotsV319Test-71681530 None] Created volume successfully. Jun 19 23:56:35 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] GroupSnapshot ca87770a-b26d-4765-9568-2c7f3165016a: creating. Jun 19 23:56:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Group snapshot ca87770a-b26d-4765-9568-2c7f3165016a: creating. {{(pid=93391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 23:56:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:35 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace 1073741824" returned: 0 in 1.238s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:35 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace Jun 19 23:56:35 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:36 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace" returned: 0 in 0.991s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.164s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f334c332-63b1-4192-8b4b-0214df4a69a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e007af-ed90-450b-a422-850e1cdaf24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Volume volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace (41cf08b6-4796-4f23-b5cf-720dfc8f9ace): created successfully Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e007af-ed90-450b-a422-850e1cdaf24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Flow 'volume_create_manager' (ef1bfa21-bf61-4c2d-b335-b1f2384c986c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Creating offline snapshot 2a2a28ad-d70c-4c3a-a9d4-56d717d2458d of volume 2f11a022-3ef5-4c1f-b72d-e59130484479 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 23:56:36 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-00d44814-f25e-4f76-8622-f3a4ddd31f1b tempest-ServerRescueNegativeTestJSON-1455901570 None] Created volume successfully. Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d590ffd-593b-4e7f-a45e-799bad71f3e4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:56:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:36 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 Jun 19 23:56:36 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Flow 'volume_create_manager' (309c3728-7ca5-4989-8d66-e649733a666a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb22e1fa-a9be-47a7-8f1d-cd4b41021940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb22e1fa-a9be-47a7-8f1d-cd4b41021940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-278686856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df3577d-8afd-45d2-a978-bc0b7a6ccf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ce4724804c410e9ce58838e6ae8eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:37Z,use_quota=True,user_id='fd525f48444e4c899cab4ea36aceaf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dad8b3a-a110-4033-b87d-f238b2542d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dad8b3a-a110-4033-b87d-f238b2542d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f515c49-cd66-400f-bbed-74b2d33b7126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f515c49-cd66-400f-bbed-74b2d33b7126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df3577d-8afd-45d2-a978-bc0b7a6ccf01', 'volume_name': 'volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99491d05-6b1f-48b6-ab62-f30751e9d619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99491d05-6b1f-48b6-ab62-f30751e9d619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ca82c2-e6b0-46f1-9b82-f3ef35977805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Volume 8df3577d-8afd-45d2-a978-bc0b7a6ccf01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01', 'volume_size': 1} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:37 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479" returned: 0 in 1.174s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:37 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d 1G Jun 19 23:56:37 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:38 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d 1G" returned: 0 in 0.913s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f11a022-3ef5-4c1f-b72d-e59130484479 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:38 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f11a022-3ef5-4c1f-b72d-e59130484479 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d Jun 19 23:56:38 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:39 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f11a022-3ef5-4c1f-b72d-e59130484479 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d" returned: 0 in 0.879s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:39 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d is being set with open permissions: ugo+rw: NotImplementedError Jun 19 23:56:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:39 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d Jun 19 23:56:39 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:40 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d" returned: 0 in 0.685s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:40 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=4,cinder:SELECT=33 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:56:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:40 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.info Jun 19 23:56:40 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:40 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.info" returned: 0 in 0.700s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:40 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 23:56:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:40 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.info Jun 19 23:56:40 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:41 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.info" returned: 0 in 0.997s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.662s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.358s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-278686856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df3577d-8afd-45d2-a978-bc0b7a6ccf01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ce4724804c410e9ce58838e6ae8eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:37Z,use_quota=True,user_id='fd525f48444e4c899cab4ea36aceaf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Creating volume 8df3577d-8afd-45d2-a978-bc0b7a6ccf01 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:56:42 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:56:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:42 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 1073741824 Jun 19 23:56:42 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:42 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a599f3a7-2cde-4915-9663-3c7d0036872c tempest-GroupSnapshotsV319Test-71681530 None] group_snapshot ca87770a-b26d-4765-9568-2c7f3165016a: created successfully Jun 19 23:56:43 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] group_snapshot ca87770a-b26d-4765-9568-2c7f3165016a: deleting Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] group_snapshot ca87770a-b26d-4765-9568-2c7f3165016a: deleting {{(pid=93391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Acquiring lock "cinder-quobyte-2f11a022-3ef5-4c1f-b72d-e59130484479" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Lock "cinder-quobyte-2f11a022-3ef5-4c1f-b72d-e59130484479" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Acquiring lock "cinder-quobyte-2a2a28ad-d70c-4c3a-a9d4-56d717d2458d" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Lock "cinder-quobyte-2a2a28ad-d70c-4c3a-a9d4-56d717d2458d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Deleting offline snapshot 2a2a28ad-d70c-4c3a-a9d4-56d717d2458d of volume 2f11a022-3ef5-4c1f-b72d-e59130484479 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] snapshot_file for this snap is: volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a011d245-5631-4461-b2d7-ec359ec423bf]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:43 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 1073741824" returned: 0 in 1.495s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:43 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d Jun 19 23:56:43 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:43 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 Jun 19 23:56:43 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:44 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d" returned: 0 in 1.002s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f11a022-3ef5-4c1f-b72d-e59130484479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:56:44 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01" returned: 0 in 0.882s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] <== create_volume: return (2477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.491s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b2ed1f-f787-40a7-87b7-e249f49040d2]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ca82c2-e6b0-46f1-9b82-f3ef35977805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e51e6bc-522d-4d65-a31e-f2eed8391ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Volume volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 (8df3577d-8afd-45d2-a978-bc0b7a6ccf01): created successfully Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e51e6bc-522d-4d65-a31e-f2eed8391ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Flow 'volume_create_manager' (309c3728-7ca5-4989-8d66-e649733a666a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3034ebf8-ad97-4ced-9027-d058b08ed133 tempest-ServersNegativeTestJSON-1789553412 None] Created volume successfully. Jun 19 23:56:44 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 Jun 19 23:56:44 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:45 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479" returned: 0 in 0.797s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:45 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d Jun 19 23:56:45 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:46 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d" returned: 0 in 0.759s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:46 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d Jun 19 23:56:46 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Flow 'volume_create_manager' (0f6ec46a-2ab8-4467-929a-bc66fde1fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0449d04e-83e4-4022-a7db-6696b723f8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0449d04e-83e4-4022-a7db-6696b723f8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1243957912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26deb63c-6969-4739-b4d8-a1a6d2ba6e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ce4724804c410e9ce58838e6ae8eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:46Z,use_quota=True,user_id='fd525f48444e4c899cab4ea36aceaf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70670d4-91e6-4e0a-bfea-80ad928553a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70670d4-91e6-4e0a-bfea-80ad928553a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e6e411-58fa-4291-b8cd-dda5fbad2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20e6e411-58fa-4291-b8cd-dda5fbad2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26deb63c-6969-4739-b4d8-a1a6d2ba6e8d', 'volume_name': 'volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8012be7-9d44-4b18-b209-a0c77433d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8012be7-9d44-4b18-b209-a0c77433d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d55d193-7085-43cb-8e3d-838930f6eee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:46 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Volume 26deb63c-6969-4739-b4d8-a1a6d2ba6e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d', 'volume_size': 1} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1243957912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26deb63c-6969-4739-b4d8-a1a6d2ba6e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ce4724804c410e9ce58838e6ae8eb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:46Z,use_quota=True,user_id='fd525f48444e4c899cab4ea36aceaf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Creating volume 26deb63c-6969-4739-b4d8-a1a6d2ba6e8d {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:56:46 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:46 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d 1073741824 Jun 19 23:56:46 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:46 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479.2a2a28ad-d70c-4c3a-a9d4-56d717d2458d" returned: 0 in 0.678s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Lock "cinder-quobyte-2a2a28ad-d70c-4c3a-a9d4-56d717d2458d" released by "_delete_snapshot" :: held 3.359s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Lock "cinder-quobyte-2f11a022-3ef5-4c1f-b72d-e59130484479" released by "delete_snapshot" :: held 3.393s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:46 devstack cinder-volume[93391]: WARNING cinder.quota [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1195983809 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1195983809, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:56:46 devstack cinder-volume[93391]: WARNING cinder.quota [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1195983809 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1195983809, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:56:46 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] Created reservations ['736a4422-66d4-49fe-914a-fb86bbbe2415', 'aa068b28-3c44-419e-ad24-b385a615d0bd', 'c51fb5a4-a837-46f4-9383-0c18b0de4376', '532a130d-dd53-4ba7-965a-ce320ecb8f4f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:56:46 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-30802fe9-2c17-47f2-898e-d07e2f4de72d tempest-GroupSnapshotsV319Test-71681530 None] group_snapshot ca87770a-b26d-4765-9568-2c7f3165016a: deleted successfully Jun 19 23:56:47 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d 1073741824" returned: 0 in 0.836s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Acquiring lock "cinder-quobyte-2f11a022-3ef5-4c1f-b72d-e59130484479" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Lock "cinder-quobyte-2f11a022-3ef5-4c1f-b72d-e59130484479" acquired by "delete_volume" :: waited 0.039s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:47 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d Jun 19 23:56:47 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:47 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec08ba3-c73a-4108-96d8-f6a180a9a1d8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:56:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:47 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 Jun 19 23:56:47 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:48 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d" returned: 0 in 0.807s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d55d193-7085-43cb-8e3d-838930f6eee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac44ea3f-19c8-460a-bc9f-69ad799a221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:48 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Volume volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d (26deb63c-6969-4739-b4d8-a1a6d2ba6e8d): created successfully Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac44ea3f-19c8-460a-bc9f-69ad799a221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Flow 'volume_create_manager' (0f6ec46a-2ab8-4467-929a-bc66fde1fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:48 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-736e6a27-638f-4500-bdd2-e870f9398f63 tempest-ServersNegativeTestJSON-1789553412 None] Created volume successfully. Jun 19 23:56:48 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479" returned: 0 in 1.007s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:48 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479 Jun 19 23:56:48 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "cinder-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Lock "cinder-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "cinder-quobyte-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Lock "cinder-quobyte-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4509a249-d547-47cc-bfb4-9ca8248d28c4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:49 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d Jun 19 23:56:49 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:49 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2f11a022-3ef5-4c1f-b72d-e59130484479" returned: 0 in 0.998s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Lock "cinder-quobyte-2f11a022-3ef5-4c1f-b72d-e59130484479" released by "delete_volume" :: held 2.095s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Created reservations ['7ae217d8-a150-4661-a3ae-f1ee11bfb269'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:56:49 devstack cinder-volume[93391]: WARNING cinder.quota [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1195983809 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1195983809, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Created reservations ['d4f6c34c-f394-4e39-afc8-6384005fbdde', 'a6c2a9c0-ceae-456a-a6b1-aad2af2028d6', '7ef1d832-3e72-4c8a-9f9a-d1fe2ca7f129', '3a1a2be5-bfda-4cde-8765-68e826a143ea'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:49 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:56:49 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:50 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d" returned: 0 in 0.934s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:50 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d Jun 19 23:56:50 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:50 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.908s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:50 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:56:50 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ecb22261-355f-404a-b004-6cda50fafe13 tempest-GroupSnapshotsV319Test-71681530 None] Delete group completed successfully. Jun 19 23:56:51 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d" returned: 0 in 1.028s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Lock "cinder-quobyte-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d" released by "delete_volume" :: held 2.048s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Created reservations ['ca25b975-f958-4088-9298-d437de0ce19d', 'f5e11f5e-4718-4e7f-b719-043df28defec', '320f920b-335c-4f43-ace3-1d67c7eef25a', 'e07410ef-6933-4d0b-847f-001bcfb6e8ba'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:51 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:56:51 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Flow 'volume_create_manager' (703036ce-61b4-48ee-ab89-7b93daaac800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3634aeb9-65a3-473f-9df5-acde62ae0115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3634aeb9-65a3-473f-9df5-acde62ae0115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1904438587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705ca32f-72bb-4752-b2b2-07a0acf74459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b253d4b2b0554bbfab18a274159946b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:52Z,use_quota=True,user_id='e22e26a4d0ff45fcbe5391a840bcc24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5893e93-1fe4-4a70-a91f-ebc074ef1d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5893e93-1fe4-4a70-a91f-ebc074ef1d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23f7e5f-2268-4c3e-85b5-9189d4026c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e23f7e5f-2268-4c3e-85b5-9189d4026c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705ca32f-72bb-4752-b2b2-07a0acf74459', 'volume_name': 'volume-705ca32f-72bb-4752-b2b2-07a0acf74459', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2db8a84-00fd-410c-88bf-a41315a27ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2db8a84-00fd-410c-88bf-a41315a27ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6f4829-cfb7-4906-b6fe-b562f18b705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:52 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Volume 705ca32f-72bb-4752-b2b2-07a0acf74459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705ca32f-72bb-4752-b2b2-07a0acf74459', 'volume_size': 1} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1904438587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705ca32f-72bb-4752-b2b2-07a0acf74459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b253d4b2b0554bbfab18a274159946b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:56:52Z,use_quota=True,user_id='e22e26a4d0ff45fcbe5391a840bcc24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Creating volume 705ca32f-72bb-4752-b2b2-07a0acf74459 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:56:52 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:52 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 1073741824 Jun 19 23:56:52 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "cinder-8df3577d-8afd-45d2-a978-bc0b7a6ccf01-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Lock "cinder-8df3577d-8afd-45d2-a978-bc0b7a6ccf01-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "cinder-quobyte-8df3577d-8afd-45d2-a978-bc0b7a6ccf01" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:56:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Lock "cinder-quobyte-8df3577d-8afd-45d2-a978-bc0b7a6ccf01" acquired by "delete_volume" :: waited 0.054s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:56:53 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d6ae5b-f26f-4570-a6e2-73425d3ce4b0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:56:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:53 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.580s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:53 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:56:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Deleted volume successfully. Jun 19 23:56:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3047b107-8c2e-4bb2-9a0c-31babf25d57b tempest-ServersNegativeTestJSON-1789553412 None] Lock "cinder-26deb63c-6969-4739-b4d8-a1a6d2ba6e8d-delete_volume" released by "delete_volume" :: held 4.158s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:53 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 Jun 19 23:56:53 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:54 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 1073741824" returned: 0 in 1.970s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:54 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 Jun 19 23:56:54 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:54 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01" returned: 0 in 1.682s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:54 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01 Jun 19 23:56:54 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459" returned: 0 in 0.847s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] <== create_volume: return (2919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.922s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:55 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e6f4829-cfb7-4906-b6fe-b562f18b705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705ca32f-72bb-4752-b2b2-07a0acf74459', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43e25b5-a4f5-417f-9194-fc2455cbfcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:56:55 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Volume volume-705ca32f-72bb-4752-b2b2-07a0acf74459 (705ca32f-72bb-4752-b2b2-07a0acf74459): created successfully Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a43e25b5-a4f5-417f-9194-fc2455cbfcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Flow 'volume_create_manager' (703036ce-61b4-48ee-ab89-7b93daaac800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:56:55 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b9226eb3-ea74-4dfc-b836-f474a080d6fd tempest-AttachVolumeNegativeTest-2045992055 None] Created volume successfully. Jun 19 23:56:55 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8df3577d-8afd-45d2-a978-bc0b7a6ccf01" returned: 0 in 1.080s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Lock "cinder-quobyte-8df3577d-8afd-45d2-a978-bc0b7a6ccf01" released by "delete_volume" :: held 2.854s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Created reservations ['2001e207-bd4c-4e47-802f-645c2740f66b', '699cfd1d-5779-460f-a924-e6b89663eafe', 'e9fe0e80-b851-4410-85cc-10e83705fbbb', '57e3b0be-87eb-4246-840d-30fd5b470492'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:56:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:56:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:56:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:56 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:56:56 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:56:56 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jun 19 23:56:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.952s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:56:56 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:56:56 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Deleted volume successfully. Jun 19 23:56:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb1855c7-0126-484a-9109-a48a5ef83049 tempest-ServersNegativeTestJSON-1789553412 None] Lock "cinder-8df3577d-8afd-45d2-a978-bc0b7a6ccf01-delete_volume" released by "delete_volume" :: held 4.195s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:56:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-ef7e53d8-9784-44bd-805d-22e185116be3 req-e75c9337-fbc2-407a-8e00-02e03d683b71 tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:56:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-ef7e53d8-9784-44bd-805d-22e185116be3 req-e75c9337-fbc2-407a-8e00-02e03d683b71 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:56:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c47c60c-2312-4418-9b79-77254872aeca]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:56:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-ef7e53d8-9784-44bd-805d-22e185116be3 req-e75c9337-fbc2-407a-8e00-02e03d683b71 tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:56:59 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 Jun 19 23:56:59 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Acquiring lock "cinder-41cf08b6-4796-4f23-b5cf-720dfc8f9ace-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "cinder-41cf08b6-4796-4f23-b5cf-720dfc8f9ace-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Acquiring lock "cinder-quobyte-41cf08b6-4796-4f23-b5cf-720dfc8f9ace" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "cinder-quobyte-41cf08b6-4796-4f23-b5cf-720dfc8f9ace" acquired by "delete_volume" :: waited 0.037s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f9a6ef-f7cd-44e5-96e5-ce7be2628d7c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:00 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace Jun 19 23:57:00 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:00 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-ef7e53d8-9784-44bd-805d-22e185116be3 req-e75c9337-fbc2-407a-8e00-02e03d683b71 tempest-AttachVolumeNegativeTest-2045992055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459" returned: 0 in 1.438s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-ef7e53d8-9784-44bd-805d-22e185116be3 req-e75c9337-fbc2-407a-8e00-02e03d683b71 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.474s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-ef7e53d8-9784-44bd-805d-22e185116be3 req-e75c9337-fbc2-407a-8e00-02e03d683b71 tempest-AttachVolumeNegativeTest-2045992055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-705ca32f-72bb-4752-b2b2-07a0acf74459', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de5614b3-c3b3-4cc7-b814-1663fb31fc90', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 23:57:00 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-ef7e53d8-9784-44bd-805d-22e185116be3 req-e75c9337-fbc2-407a-8e00-02e03d683b71 tempest-AttachVolumeNegativeTest-2045992055 None] attachment_update completed successfully. Jun 19 23:57:01 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace" returned: 0 in 1.511s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:01 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace Jun 19 23:57:01 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:02 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41cf08b6-4796-4f23-b5cf-720dfc8f9ace" returned: 0 in 0.782s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "cinder-quobyte-41cf08b6-4796-4f23-b5cf-720dfc8f9ace" released by "delete_volume" :: held 2.363s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Created reservations ['80215ab4-9c4e-4bf9-8f9f-4aa86e3ee62a', '0cccdd97-6b4b-47cf-b3e8-fc289c5fa3f7', 'c72dafc5-0607-4bf6-a17b-eb15ad8e212d', '7a820bd3-2144-4ad5-b277-4c9afab2f324'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:02 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:57:02 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:04 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.303s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:04 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:57:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Deleted volume successfully. Jun 19 23:57:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ecf652b7-a743-4448-a166-906c029c298d tempest-ServerRescueNegativeTestJSON-1455901570 None] Lock "cinder-41cf08b6-4796-4f23-b5cf-720dfc8f9ace-delete_volume" released by "delete_volume" :: held 4.021s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:57:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-6e2a322a-d592-4157-a355-24f968d4df10 req-a2754185-68ab-4bd0-8f79-55de28042e58 tempest-AttachVolumeNegativeTest-2045992055 None] Terminate volume connection completed successfully. Jun 19 23:57:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-6e2a322a-d592-4157-a355-24f968d4df10 req-a2754185-68ab-4bd0-8f79-55de28042e58 tempest-AttachVolumeNegativeTest-2045992055 None] Deleting attachment de5614b3-c3b3-4cc7-b814-1663fb31fc90. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:57:19 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=51,cinder:SELECT=41,cinder:INSERT=13,cinder:DELETE=4 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:57:19 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=61,cinder:UPDATE=62,cinder:DELETE=4,cinder:INSERT=12 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Flow 'volume_create_manager' (d8321684-8958-41af-aa96-14e9e237368a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a013dc-7b02-4d67-bac6-472155e1d4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a013dc-7b02-4d67-bac6-472155e1d4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-474590604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f9fc96-0d3c-4146-ac3f-b11911de54c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b10b565d6f4b83ae8f94740f2b199c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:57:22Z,use_quota=True,user_id='1b2d22daca724c38ba2334e49029c295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1d1117-6656-4e8a-bcec-ebf08ac4bd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f1d1117-6656-4e8a-bcec-ebf08ac4bd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027fbb0b-8d63-458a-a2ba-855ed04145af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (027fbb0b-8d63-458a-a2ba-855ed04145af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f9fc96-0d3c-4146-ac3f-b11911de54c2', 'volume_name': 'volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01abf22b-5e59-4d65-9197-78d95fa633ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01abf22b-5e59-4d65-9197-78d95fa633ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5962c80-c0b2-47b5-8e66-0d1aafa9c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:22 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Volume a0f9fc96-0d3c-4146-ac3f-b11911de54c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2', 'volume_size': 1} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-474590604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f9fc96-0d3c-4146-ac3f-b11911de54c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b10b565d6f4b83ae8f94740f2b199c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:57:22Z,use_quota=True,user_id='1b2d22daca724c38ba2334e49029c295',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Creating volume a0f9fc96-0d3c-4146-ac3f-b11911de54c2 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:57:22 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:57:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:22 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 1073741824 Jun 19 23:57:22 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:23 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 1073741824" returned: 0 in 1.070s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:23 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 Jun 19 23:57:23 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:24 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2" returned: 0 in 0.759s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:57:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5962c80-c0b2-47b5-8e66-0d1aafa9c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7ca65d-0116-4bf8-8970-4d842b09bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:24 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Volume volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 (a0f9fc96-0d3c-4146-ac3f-b11911de54c2): created successfully Jun 19 23:57:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf7ca65d-0116-4bf8-8970-4d842b09bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Flow 'volume_create_manager' (d8321684-8958-41af-aa96-14e9e237368a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:57:24 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-081bae48-52d1-4bae-8523-3c9cd6ab301c tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Created volume successfully. Jun 19 23:57:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Acquiring lock "cinder-a0f9fc96-0d3c-4146-ac3f-b11911de54c2-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:57:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "cinder-a0f9fc96-0d3c-4146-ac3f-b11911de54c2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:57:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Acquiring lock "cinder-quobyte-a0f9fc96-0d3c-4146-ac3f-b11911de54c2" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:57:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "cinder-quobyte-a0f9fc96-0d3c-4146-ac3f-b11911de54c2" acquired by "delete_volume" :: waited 0.031s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:57:26 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b146b2-3aa4-4cc7-bb2b-e85d413208c7]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:57:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:26 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 Jun 19 23:57:26 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:27 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2" returned: 0 in 0.924s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:27 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2 Jun 19 23:57:27 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:28 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:57:28 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:28 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a0f9fc96-0d3c-4146-ac3f-b11911de54c2" returned: 0 in 1.172s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "cinder-quobyte-a0f9fc96-0d3c-4146-ac3f-b11911de54c2" released by "delete_volume" :: held 2.162s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Created reservations ['9be34f45-00fa-41f6-8f95-982d99ff3adb', 'f999b8f1-fc11-4cb6-af94-c412a1f57414', 'ff38114d-120d-4d76-a717-56c9158f7a98', 'cffe2b04-fc56-449a-ae19-6004f6f48a40'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:57:29 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.029s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:29 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:57:29 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:29 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.823s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:57:29 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Deleted volume successfully. Jun 19 23:57:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-006b574d-9288-4a6c-93f8-6f45dba5a9d2 tempest-VolumeQuotasNegativeTestJSON-2071296162 None] Lock "cinder-a0f9fc96-0d3c-4146-ac3f-b11911de54c2-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:57:39 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:57:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a94d442f-9530-4337-bcbe-9720a99dada8 tempest-GroupsTest-541007505 None] Group tempest-Group1-1539040404: creating Jun 19 23:57:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a94d442f-9530-4337-bcbe-9720a99dada8 tempest-GroupsTest-541007505 None] Group tempest-Group1-1539040404: created successfully Jun 19 23:57:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a94d442f-9530-4337-bcbe-9720a99dada8 tempest-GroupsTest-541007505 None] Create group completed successfully. Jun 19 23:57:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ce185978-f842-4931-88b3-a6bf7410d3c8 tempest-GroupsTest-541007505 None] Group tempest-Group2-729670604: creating Jun 19 23:57:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ce185978-f842-4931-88b3-a6bf7410d3c8 tempest-GroupsTest-541007505 None] Group tempest-Group2-729670604: created successfully Jun 19 23:57:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ce185978-f842-4931-88b3-a6bf7410d3c8 tempest-GroupsTest-541007505 None] Create group completed successfully. Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Flow 'volume_create_manager' (2ee6c7d3-4bab-48d5-9ed7-59d9122ad153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b5eeb8-76cb-4e59-9850-6153a4cc5057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b5eeb8-76cb-4e59-9850-6153a4cc5057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-913898270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf61d45e-1369-440b-b4ef-51f7709da272,host='devstack@QuobyteHD#QuobyteHD',id=d7aa4a09-71be-4011-97e6-d1fdb4dc5568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee3df00632347b8a1a5a222a54c1f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:57:42Z,use_quota=True,user_id='a4d39cacc716488a8692413637e819c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac609ecd-701d-4933-a0e0-6dbad7f18d85),volume_type_id=ac609ecd-701d-4933-a0e0-6dbad7f18d85)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e246aa5-6e04-4946-a2f2-b2f58a3126f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e246aa5-6e04-4946-a2f2-b2f58a3126f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa73bd8c-ffab-45dd-9edd-04dc738cfb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa73bd8c-ffab-45dd-9edd-04dc738cfb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7aa4a09-71be-4011-97e6-d1fdb4dc5568', 'volume_name': 'volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19d6653-713e-4693-a63a-878b82fb4604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19d6653-713e-4693-a63a-878b82fb4604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c51e9bb-0845-41b9-98a0-810e33880a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:42 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Volume d7aa4a09-71be-4011-97e6-d1fdb4dc5568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568', 'volume_size': 1} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cf61d45e-1369-440b-b4ef-51f7709da272,created_at=2026-06-19T21:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-913898270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf61d45e-1369-440b-b4ef-51f7709da272,host='devstack@QuobyteHD#QuobyteHD',id=d7aa4a09-71be-4011-97e6-d1fdb4dc5568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee3df00632347b8a1a5a222a54c1f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:57:42Z,use_quota=True,user_id='a4d39cacc716488a8692413637e819c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac609ecd-701d-4933-a0e0-6dbad7f18d85),volume_type_id=ac609ecd-701d-4933-a0e0-6dbad7f18d85)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Creating volume d7aa4a09-71be-4011-97e6-d1fdb4dc5568 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:57:42 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:57:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:42 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 1073741824 Jun 19 23:57:42 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:43 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 1073741824" returned: 0 in 0.878s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:43 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 Jun 19 23:57:43 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:44 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568" returned: 0 in 0.729s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:57:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c51e9bb-0845-41b9-98a0-810e33880a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c59a766-998e-4228-ba09-95113f1b27a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Volume volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 (d7aa4a09-71be-4011-97e6-d1fdb4dc5568): created successfully Jun 19 23:57:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c59a766-998e-4228-ba09-95113f1b27a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Flow 'volume_create_manager' (2ee6c7d3-4bab-48d5-9ed7-59d9122ad153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:57:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-9c9e636b-3c6b-4f9f-bed1-708c4f15ce01 tempest-GroupsTest-541007505 None] Created volume successfully. Jun 19 23:57:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Acquiring lock "cinder-quobyte-d7aa4a09-71be-4011-97e6-d1fdb4dc5568" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:57:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Lock "cinder-quobyte-d7aa4a09-71be-4011-97e6-d1fdb4dc5568" acquired by "delete_volume" :: waited 0.045s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:57:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a0b75-4aa1-4b0b-91b2-9026b13b74b4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:57:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:46 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 Jun 19 23:57:46 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:47 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568" returned: 0 in 1.158s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:47 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568 Jun 19 23:57:47 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:48 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7aa4a09-71be-4011-97e6-d1fdb4dc5568" returned: 0 in 1.479s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Lock "cinder-quobyte-d7aa4a09-71be-4011-97e6-d1fdb4dc5568" released by "delete_volume" :: held 2.734s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:57:49 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Created reservations ['9cdb2c1a-4c7e-436d-8446-9384529dde32'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:57:49 devstack cinder-volume[93391]: WARNING cinder.quota [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2046452996 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2046452996, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:57:49 devstack cinder-volume[93391]: WARNING cinder.quota [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2046452996 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2046452996, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:57:49 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Created reservations ['c53acab7-40c4-45b0-8066-493d2c6db35c', 'bb6842cc-52bc-488a-8dd8-242291d9c5d7', 'c0d52575-c8f8-4122-a2ab-5ce35d5757b3', '2f8a5cb1-5ffe-43a0-b40d-68acc24fa5dc'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:57:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:57:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:57:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:49 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:57:49 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:50 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Created reservations ['73adbd6e-7b32-4b99-ad7e-2d2d40ab11ad'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:57:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:57:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:57:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:50 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:57:50 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:51 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.518s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:51 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:57:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-89dee96a-af33-4958-b557-7344931375c3 tempest-GroupsTest-541007505 None] Delete group completed successfully. Jun 19 23:57:52 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.386s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:52 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:57:52 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-82e53ee1-92b1-4b38-bd2e-65a6bba95371 tempest-GroupsTest-541007505 None] Delete group completed successfully. Jun 19 23:57:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-cff8839b-041c-4070-ae2c-634b00d0daae tempest-GroupsTest-541007505 None] Group tempest-GroupsTest-Group-1117552869: creating Jun 19 23:57:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-cff8839b-041c-4070-ae2c-634b00d0daae tempest-GroupsTest-541007505 None] Group tempest-GroupsTest-Group-1117552869: created successfully Jun 19 23:57:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-cff8839b-041c-4070-ae2c-634b00d0daae tempest-GroupsTest-541007505 None] Create group completed successfully. Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Flow 'volume_create_manager' (a2eabb5f-030d-40f9-b8d6-7f34b860423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76cf6a0-3200-46fb-983d-4f093165b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a76cf6a0-3200-46fb-983d-4f093165b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1737883962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63f4bb1d-4320-4ab8-ad1b-59a31d8866c9,host='devstack@QuobyteHD#QuobyteHD',id=1e1fb8c5-7313-45bf-b853-5b0580d5831c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee3df00632347b8a1a5a222a54c1f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:57:55Z,use_quota=True,user_id='a4d39cacc716488a8692413637e819c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e20ee4-22a0-45af-821f-405e06bac265),volume_type_id=05e20ee4-22a0-45af-821f-405e06bac265)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d134ba75-dea4-45dc-8231-64259d83813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d134ba75-dea4-45dc-8231-64259d83813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4174675e-089b-4a24-a353-da0de893d647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4174675e-089b-4a24-a353-da0de893d647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1fb8c5-7313-45bf-b853-5b0580d5831c', 'volume_name': 'volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc08053-9d05-4764-8208-69be213a8f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc08053-9d05-4764-8208-69be213a8f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d067e1e2-95ff-4889-971b-ee6de1670ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:55 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Volume 1e1fb8c5-7313-45bf-b853-5b0580d5831c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c', 'volume_size': 1} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63f4bb1d-4320-4ab8-ad1b-59a31d8866c9,created_at=2026-06-19T21:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1737883962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63f4bb1d-4320-4ab8-ad1b-59a31d8866c9,host='devstack@QuobyteHD#QuobyteHD',id=1e1fb8c5-7313-45bf-b853-5b0580d5831c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee3df00632347b8a1a5a222a54c1f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:57:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:57:55Z,use_quota=True,user_id='a4d39cacc716488a8692413637e819c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e20ee4-22a0-45af-821f-405e06bac265),volume_type_id=05e20ee4-22a0-45af-821f-405e06bac265)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Creating volume 1e1fb8c5-7313-45bf-b853-5b0580d5831c {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:57:55 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:57:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:55 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c 1073741824 Jun 19 23:57:55 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:57 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c 1073741824" returned: 0 in 1.848s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:57:57 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c Jun 19 23:57:57 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:57:58 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jun 19 23:57:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c" returned: 0 in 1.423s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:57:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] <== create_volume: return (3368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:57:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.370s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:57:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d067e1e2-95ff-4889-971b-ee6de1670ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4aa17c-b209-4a23-9cc5-479238b2aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:57:58 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Volume volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c (1e1fb8c5-7313-45bf-b853-5b0580d5831c): created successfully Jun 19 23:57:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4aa17c-b209-4a23-9cc5-479238b2aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:57:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Flow 'volume_create_manager' (a2eabb5f-030d-40f9-b8d6-7f34b860423d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:57:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fc64aa4a-77d3-4216-acb9-fbacaec7b302 tempest-GroupsTest-541007505 None] Created volume successfully. Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Flow 'volume_create_manager' (e89cc34f-f1bf-4c73-b2b7-57b980350a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a24754-4693-4d61-b077-e4c3ff20e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a24754-4693-4d61-b077-e4c3ff20e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678596891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63f4bb1d-4320-4ab8-ad1b-59a31d8866c9,host='devstack@QuobyteHD#QuobyteHD',id=c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee3df00632347b8a1a5a222a54c1f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:01Z,use_quota=True,user_id='a4d39cacc716488a8692413637e819c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e20ee4-22a0-45af-821f-405e06bac265),volume_type_id=05e20ee4-22a0-45af-821f-405e06bac265)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ad9723-8867-4714-bbcd-1ca69943c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ad9723-8867-4714-bbcd-1ca69943c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14887996-a2b4-4c1e-b1f4-ab4993a60754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14887996-a2b4-4c1e-b1f4-ab4993a60754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6', 'volume_name': 'volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60e39cd-a77d-4f9e-97da-726ce0d9598b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60e39cd-a77d-4f9e-97da-726ce0d9598b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3afbcb-ae8c-4cb1-a5ee-f515c623190f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:00 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Volume c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6', 'volume_size': 1} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63f4bb1d-4320-4ab8-ad1b-59a31d8866c9,created_at=2026-06-19T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678596891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63f4bb1d-4320-4ab8-ad1b-59a31d8866c9,host='devstack@QuobyteHD#QuobyteHD',id=c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ee3df00632347b8a1a5a222a54c1f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:01Z,use_quota=True,user_id='a4d39cacc716488a8692413637e819c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05e20ee4-22a0-45af-821f-405e06bac265),volume_type_id=05e20ee4-22a0-45af-821f-405e06bac265)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Creating volume c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:58:00 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:58:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:00 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 1073741824 Jun 19 23:58:00 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Flow 'volume_create_manager' (ca1ed4df-d11f-43c7-b446-e7425c3cc087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4aabdd-6fed-4915-a3a1-bbd3f48b841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf4aabdd-6fed-4915-a3a1-bbd3f48b841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2020311988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27033a71-f659-4a2f-b89b-01ede6baaad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e137fd027240fc9f0322d11a0dbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:01Z,use_quota=True,user_id='7bea43b91f3f4f4f9317372c09abb274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a34a2e9-42e2-45f1-b6eb-e0bada6ec191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a34a2e9-42e2-45f1-b6eb-e0bada6ec191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bf75c8-de60-4fac-a91c-806d2d4dbfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bf75c8-de60-4fac-a91c-806d2d4dbfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27033a71-f659-4a2f-b89b-01ede6baaad1', 'volume_name': 'volume-27033a71-f659-4a2f-b89b-01ede6baaad1', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cbd3d1-1a6d-4a18-815b-2252fe01bb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cbd3d1-1a6d-4a18-815b-2252fe01bb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d026c74-290a-46b0-b694-54381935f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:01 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Volume 27033a71-f659-4a2f-b89b-01ede6baaad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27033a71-f659-4a2f-b89b-01ede6baaad1', 'volume_size': 1} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:01 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 1073741824" returned: 0 in 1.032s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:02 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 Jun 19 23:58:02 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:02 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6" returned: 0 in 0.666s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.500s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2020311988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27033a71-f659-4a2f-b89b-01ede6baaad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83e137fd027240fc9f0322d11a0dbbf5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:01Z,use_quota=True,user_id='7bea43b91f3f4f4f9317372c09abb274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Creating volume 27033a71-f659-4a2f-b89b-01ede6baaad1 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:58:02 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:02 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 1073741824 Jun 19 23:58:02 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3afbcb-ae8c-4cb1-a5ee-f515c623190f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b93c291-d38c-455b-a62f-accde675eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:02 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Volume volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 (c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6): created successfully Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b93c291-d38c-455b-a62f-accde675eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Flow 'volume_create_manager' (e89cc34f-f1bf-4c73-b2b7-57b980350a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d497850e-d7a2-4db2-8c26-6ea0156a404b tempest-GroupsTest-541007505 None] Created volume successfully. Jun 19 23:58:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3c4b5954-95c4-453f-add8-da8c91a71384 tempest-GroupsTest-541007505 None] Update group completed successfully. Jun 19 23:58:03 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 1073741824" returned: 0 in 0.897s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:03 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 Jun 19 23:58:03 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:04 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1" returned: 0 in 0.706s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:58:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d026c74-290a-46b0-b694-54381935f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27033a71-f659-4a2f-b89b-01ede6baaad1', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ceb445-4fd4-45f4-b66a-a7b40f87afc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:04 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Volume volume-27033a71-f659-4a2f-b89b-01ede6baaad1 (27033a71-f659-4a2f-b89b-01ede6baaad1): created successfully Jun 19 23:58:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ceb445-4fd4-45f4-b66a-a7b40f87afc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Flow 'volume_create_manager' (ca1ed4df-d11f-43c7-b446-e7425c3cc087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2d1adb51-cd3b-48e7-b17e-43ac5cbd36ef tempest-AbsoluteLimitsTests-762703333 None] Created volume successfully. Jun 19 23:58:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-cf58f283-1e4e-45f5-9699-b981138b8dda tempest-GroupsTest-541007505 None] Update group completed successfully. Jun 19 23:58:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Acquiring lock "cinder-27033a71-f659-4a2f-b89b-01ede6baaad1-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Lock "cinder-27033a71-f659-4a2f-b89b-01ede6baaad1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Acquiring lock "cinder-quobyte-27033a71-f659-4a2f-b89b-01ede6baaad1" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Lock "cinder-quobyte-27033a71-f659-4a2f-b89b-01ede6baaad1" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:05 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2baaa5-e329-4753-84f5-2d1b2eb57363]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:05 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 Jun 19 23:58:05 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:06 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1" returned: 0 in 0.798s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:06 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1 Jun 19 23:58:06 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Acquiring lock "cinder-quobyte-1e1fb8c5-7313-45bf-b853-5b0580d5831c" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Lock "cinder-quobyte-1e1fb8c5-7313-45bf-b853-5b0580d5831c" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc42b74-7c99-417f-9434-018ac268bb03]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:06 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c Jun 19 23:58:06 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:06 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-27033a71-f659-4a2f-b89b-01ede6baaad1" returned: 0 in 0.734s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Lock "cinder-quobyte-27033a71-f659-4a2f-b89b-01ede6baaad1" released by "delete_volume" :: held 1.582s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:06 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Created reservations ['690d99dd-a15b-423e-a868-5dfdcbb732ae', 'c78571a2-7eee-45ad-a2af-68fe0c023f63', '2ae69692-e8ca-4b51-832c-2ad8309b0a66', '05e0e7e6-6058-4c54-9ccd-2f0953ffe1c1'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:07 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:07 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:07 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c" returned: 0 in 0.854s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:07 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c Jun 19 23:58:07 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:07 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.834s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Deleted volume successfully. Jun 19 23:58:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e99e01ba-6950-4be2-8285-67bcb0d703b8 tempest-AbsoluteLimitsTests-762703333 None] Lock "cinder-27033a71-f659-4a2f-b89b-01ede6baaad1-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:08 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e1fb8c5-7313-45bf-b853-5b0580d5831c" returned: 0 in 0.795s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Lock "cinder-quobyte-1e1fb8c5-7313-45bf-b853-5b0580d5831c" released by "delete_volume" :: held 1.707s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Acquiring lock "cinder-quobyte-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Lock "cinder-quobyte-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:08 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2641218a-e8f0-4810-a2fc-b952b1d11486]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:08 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 Jun 19 23:58:08 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:09 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6" returned: 0 in 0.944s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:09 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6 Jun 19 23:58:09 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:09 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6" returned: 0 in 0.784s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Lock "cinder-quobyte-c8d6f57e-ab24-4a0f-8a3c-3633f00d63a6" released by "delete_volume" :: held 1.780s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Created reservations ['9d3abc8f-f231-413f-9be2-ca560b56ee61'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:10 devstack cinder-volume[93391]: WARNING cinder.quota [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-439225108 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-439225108, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:58:10 devstack cinder-volume[93391]: WARNING cinder.quota [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-439225108 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-439225108, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Created reservations ['af53f06d-9d9f-4f4f-b49b-ef4267211e54', '11ef9962-7451-48ff-b267-fcc1e7a7821d', '601ac55a-058d-413c-8296-7de32fd729b8', 'b0c43ad2-1994-4fd6-83fa-0f03cd3e7081'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Created reservations ['e78ecd05-9f93-4847-adef-dc295a41c3ae', '400534c5-de5b-46bb-b1d1-ae5e1c296fb6', '7bbec4ec-b2aa-49dd-8317-b7e01c9d7745', 'c1184f8b-52a0-4a66-8609-3f83b39df04d'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:10 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:10 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:11 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.675s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:11 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:11 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-384dfd23-1c48-4cef-9bec-e98c2d511838 tempest-GroupsTest-541007505 None] Delete group completed successfully. Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Flow 'volume_create_manager' (c843c78b-871e-4e10-b77a-494cc82ef1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23aa672-4e86-48ac-b029-533680ddcf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23aa672-4e86-48ac-b029-533680ddcf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-169054952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef54796-190f-48fb-a7da-1920ddf67d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d01b3e88f84ca0bacd072e1b71dc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:12Z,use_quota=True,user_id='6427494b8bfe48978258e27e388bbb40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d4e094-af6f-43d0-954c-fa35b553afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d4e094-af6f-43d0-954c-fa35b553afba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fa172e-0e0d-407a-91b9-933a3c69ddab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7fa172e-0e0d-407a-91b9-933a3c69ddab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef54796-190f-48fb-a7da-1920ddf67d58', 'volume_name': 'volume-5ef54796-190f-48fb-a7da-1920ddf67d58', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf39e67-03db-4e84-950a-e02d13d54de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf39e67-03db-4e84-950a-e02d13d54de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226fc547-5d30-457a-b60a-2d86a8f611ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:12 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Volume 5ef54796-190f-48fb-a7da-1920ddf67d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef54796-190f-48fb-a7da-1920ddf67d58', 'volume_size': 1} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-169054952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef54796-190f-48fb-a7da-1920ddf67d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d01b3e88f84ca0bacd072e1b71dc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:12Z,use_quota=True,user_id='6427494b8bfe48978258e27e388bbb40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Creating volume 5ef54796-190f-48fb-a7da-1920ddf67d58 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:58:12 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:58:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:12 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 1073741824 Jun 19 23:58:12 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:13 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 1073741824" returned: 0 in 1.057s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:13 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 Jun 19 23:58:13 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:14 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58" returned: 0 in 0.838s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226fc547-5d30-457a-b60a-2d86a8f611ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef54796-190f-48fb-a7da-1920ddf67d58', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baf284f-47f5-43e7-bfc7-e1eecb387c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:14 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Volume volume-5ef54796-190f-48fb-a7da-1920ddf67d58 (5ef54796-190f-48fb-a7da-1920ddf67d58): created successfully Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8baf284f-47f5-43e7-bfc7-e1eecb387c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Flow 'volume_create_manager' (c843c78b-871e-4e10-b77a-494cc82ef1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-9f70c3d5-bb13-4b1a-b399-c9ddc218473d tempest-VolumesMetadataTest-1427625396 None] Created volume successfully. Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Flow 'volume_create_manager' (718ab6d0-53ec-43c2-a3cd-f0e77af77154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87606fd7-c8cc-4c1e-9bb4-b02982408c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87606fd7-c8cc-4c1e-9bb4-b02982408c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1416393253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd268a87-b9ad-4a5f-a548-95b66a2ae586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b253d4b2b0554bbfab18a274159946b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:14Z,use_quota=True,user_id='e22e26a4d0ff45fcbe5391a840bcc24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b8fae0-3b38-425e-8491-3e4c44302b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b8fae0-3b38-425e-8491-3e4c44302b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595a90d6-374a-4d20-84a6-0d15f2964cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595a90d6-374a-4d20-84a6-0d15f2964cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd268a87-b9ad-4a5f-a548-95b66a2ae586', 'volume_name': 'volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6730b52d-55e2-4dee-8d39-dbae09ac1775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6730b52d-55e2-4dee-8d39-dbae09ac1775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76683e5d-2fe0-4c3b-8486-90fbf471551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:14 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Volume dd268a87-b9ad-4a5f-a548-95b66a2ae586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586', 'volume_size': 1} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1416393253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd268a87-b9ad-4a5f-a548-95b66a2ae586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b253d4b2b0554bbfab18a274159946b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:14Z,use_quota=True,user_id='e22e26a4d0ff45fcbe5391a840bcc24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Creating volume dd268a87-b9ad-4a5f-a548-95b66a2ae586 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:58:14 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:58:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:14 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 1073741824 Jun 19 23:58:14 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:15 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 1073741824" returned: 0 in 0.869s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:15 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 Jun 19 23:58:15 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:16 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586" returned: 0 in 0.758s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76683e5d-2fe0-4c3b-8486-90fbf471551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873c6a3a-bf9a-4fba-ab10-6b4e2b902978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:16 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Volume volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 (dd268a87-b9ad-4a5f-a548-95b66a2ae586): created successfully Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873c6a3a-bf9a-4fba-ab10-6b4e2b902978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Flow 'volume_create_manager' (718ab6d0-53ec-43c2-a3cd-f0e77af77154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:16 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a8018414-3672-41ff-a0c4-7e72adbf099a tempest-AttachVolumeNegativeTest-2045992055 None] Created volume successfully. Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Acquiring lock "cinder-5ef54796-190f-48fb-a7da-1920ddf67d58-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Lock "cinder-5ef54796-190f-48fb-a7da-1920ddf67d58-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Acquiring lock "cinder-quobyte-5ef54796-190f-48fb-a7da-1920ddf67d58" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Lock "cinder-quobyte-5ef54796-190f-48fb-a7da-1920ddf67d58" acquired by "delete_volume" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c857b5-5b58-48fb-8ce5-4de0c0a9bab8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:16 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 Jun 19 23:58:16 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Flow 'volume_create_manager' (d8dba97b-6d10-4bac-91e6-c1dd94e08d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab73e2d-a2c2-4e6e-a6e6-145d187df0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab73e2d-a2c2-4e6e-a6e6-145d187df0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-138096637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae00bb6-7685-443f-a3c3-c1dbffe1f663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50bf88eebe24f4ca7dd257958132da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:17Z,use_quota=True,user_id='81a08288f58a4dd98e7dcd6383000b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679294cd-72d4-4f00-8ca4-929605fc54a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679294cd-72d4-4f00-8ca4-929605fc54a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9130caf2-57e4-4570-942f-aa3071132363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9130caf2-57e4-4570-942f-aa3071132363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae00bb6-7685-443f-a3c3-c1dbffe1f663', 'volume_name': 'volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9f9826-1a9e-499d-85b8-3978c433e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9f9826-1a9e-499d-85b8-3978c433e53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd45d040-de46-4bb2-a210-64992bb9ed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:17 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Volume 1ae00bb6-7685-443f-a3c3-c1dbffe1f663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663', 'volume_size': 1} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-138096637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae00bb6-7685-443f-a3c3-c1dbffe1f663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50bf88eebe24f4ca7dd257958132da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:17Z,use_quota=True,user_id='81a08288f58a4dd98e7dcd6383000b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Creating volume 1ae00bb6-7685-443f-a3c3-c1dbffe1f663 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:58:17 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:17 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 1073741824 Jun 19 23:58:17 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-36f578f9-3f56-4bb7-8ea4-801e1ab2a8d6 tempest-GroupsV320Test-595911382 None] Group tempest-GroupsV320Test-Group-641793424: creating Jun 19 23:58:17 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-36f578f9-3f56-4bb7-8ea4-801e1ab2a8d6 tempest-GroupsV320Test-595911382 None] Group tempest-GroupsV320Test-Group-641793424: created successfully Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58" returned: 0 in 0.905s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-36f578f9-3f56-4bb7-8ea4-801e1ab2a8d6 tempest-GroupsV320Test-595911382 None] Create group completed successfully. Jun 19 23:58:17 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58 Jun 19 23:58:17 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:17 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5ef54796-190f-48fb-a7da-1920ddf67d58" returned: 0 in 0.689s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Lock "cinder-quobyte-5ef54796-190f-48fb-a7da-1920ddf67d58" released by "delete_volume" :: held 1.648s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:18 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 1073741824" returned: 0 in 0.906s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Created reservations ['8c07530d-742c-40c1-b277-671948884161', '643ed86d-d7f8-4023-92cd-7d7a0448b40d', '17b9237e-92af-4b1a-9147-4362a122c688', '70f2c238-64e1-4225-80f3-0c8c3aaf4e22'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:18 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 Jun 19 23:58:18 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:18 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:18 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:18 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663" returned: 0 in 0.826s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd45d040-de46-4bb2-a210-64992bb9ed9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ffa774-f58f-4047-97be-acf57ec22ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:19 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Volume volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 (1ae00bb6-7685-443f-a3c3-c1dbffe1f663): created successfully Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ffa774-f58f-4047-97be-acf57ec22ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Flow 'volume_create_manager' (d8dba97b-6d10-4bac-91e6-c1dd94e08d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:19 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-401ce5c2-f4c8-4eb0-b6b0-8e4b50e85705 tempest-AttachVolumeTestJSON-148826376 None] Created volume successfully. Jun 19 23:58:19 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.905s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:19 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Deleted volume successfully. Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=77,cinder:SELECT=64,cinder:INSERT=22,cinder:DELETE=6 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Created reservations ['fb89823a-2e55-4821-b466-4ee199954568'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3235e1e9-a679-48e4-9d56-2b326ee380e6 tempest-VolumesMetadataTest-1427625396 None] Lock "cinder-5ef54796-190f-48fb-a7da-1920ddf67d58-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:19 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:19 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-431b7c08-2d58-4f71-8655-8b2d153e808a req-17a4a9c0-f0e6-4595-9e7f-8eb84e7b93b0 tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-431b7c08-2d58-4f71-8655-8b2d153e808a req-17a4a9c0-f0e6-4595-9e7f-8eb84e7b93b0 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24600b7-3c6e-4a97-a883-dd597af1ddb4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-431b7c08-2d58-4f71-8655-8b2d153e808a req-17a4a9c0-f0e6-4595-9e7f-8eb84e7b93b0 tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:19 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 Jun 19 23:58:19 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:19 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.717s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:19 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:19 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1649b1c5-ccad-4083-9d60-6c099316cc22 tempest-GroupsV320Test-595911382 None] Delete group completed successfully. Jun 19 23:58:20 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-431b7c08-2d58-4f71-8655-8b2d153e808a req-17a4a9c0-f0e6-4595-9e7f-8eb84e7b93b0 tempest-AttachVolumeNegativeTest-2045992055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586" returned: 0 in 0.897s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-431b7c08-2d58-4f71-8655-8b2d153e808a req-17a4a9c0-f0e6-4595-9e7f-8eb84e7b93b0 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-431b7c08-2d58-4f71-8655-8b2d153e808a req-17a4a9c0-f0e6-4595-9e7f-8eb84e7b93b0 tempest-AttachVolumeNegativeTest-2045992055 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b030a420-df84-40c1-8aa3-00fef46f26dd', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 23:58:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-431b7c08-2d58-4f71-8655-8b2d153e808a req-17a4a9c0-f0e6-4595-9e7f-8eb84e7b93b0 tempest-AttachVolumeNegativeTest-2045992055 None] attachment_update completed successfully. Jun 19 23:58:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-21bf8fb9-8e29-4967-9553-3cc2afcd4792 req-c71bd644-8c62-4ca9-955d-4a7510fccba6 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-21bf8fb9-8e29-4967-9553-3cc2afcd4792 req-c71bd644-8c62-4ca9-955d-4a7510fccba6 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:23 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[68812e38-8f4a-4ad0-95eb-86a168d55442]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-21bf8fb9-8e29-4967-9553-3cc2afcd4792 req-c71bd644-8c62-4ca9-955d-4a7510fccba6 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:23 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 Jun 19 23:58:23 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:23 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Flow 'volume_create_manager' (26394b10-8764-4f59-8fac-fd5ce8138c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87c0780-c246-4267-8a4f-c9eb49cc20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87c0780-c246-4267-8a4f-c9eb49cc20b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2053517605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb68e9af-9103-4cbc-bea3-263050a698a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441458615ea24867b930b6b6165bf037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:24Z,use_quota=True,user_id='960cfe32649c4267b2ca94318082b52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025516f8-8332-49b8-a624-32f3cda90561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025516f8-8332-49b8-a624-32f3cda90561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3cbbaf-56c3-4611-a827-c27ca5a1ecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3cbbaf-56c3-4611-a827-c27ca5a1ecfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb68e9af-9103-4cbc-bea3-263050a698a7', 'volume_name': 'volume-fb68e9af-9103-4cbc-bea3-263050a698a7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcd8f58-2897-4ca1-85b6-a20d8a5aedf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcd8f58-2897-4ca1-85b6-a20d8a5aedf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad6b7fe-9e37-46e1-828d-6e0898c3a662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:24 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Volume fb68e9af-9103-4cbc-bea3-263050a698a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb68e9af-9103-4cbc-bea3-263050a698a7', 'volume_size': 1} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:24 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-21bf8fb9-8e29-4967-9553-3cc2afcd4792 req-c71bd644-8c62-4ca9-955d-4a7510fccba6 tempest-AttachVolumeTestJSON-148826376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663" returned: 0 in 0.826s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-21bf8fb9-8e29-4967-9553-3cc2afcd4792 req-c71bd644-8c62-4ca9-955d-4a7510fccba6 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.851s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2053517605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb68e9af-9103-4cbc-bea3-263050a698a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441458615ea24867b930b6b6165bf037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:24Z,use_quota=True,user_id='960cfe32649c4267b2ca94318082b52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Creating volume fb68e9af-9103-4cbc-bea3-263050a698a7 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:58:24 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:24 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 1073741824 Jun 19 23:58:24 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-21bf8fb9-8e29-4967-9553-3cc2afcd4792 req-c71bd644-8c62-4ca9-955d-4a7510fccba6 tempest-AttachVolumeTestJSON-148826376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '563a0ece-3110-456c-95dd-dfa3787b9fbb', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 23:58:24 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-21bf8fb9-8e29-4967-9553-3cc2afcd4792 req-c71bd644-8c62-4ca9-955d-4a7510fccba6 tempest-AttachVolumeTestJSON-148826376 None] attachment_update completed successfully. Jun 19 23:58:25 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 1073741824" returned: 0 in 0.935s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:25 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 Jun 19 23:58:25 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Flow 'volume_create_manager' (32e4ab56-cb7e-4d9e-8e58-5fc0019831ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcf895c-ddfd-4477-a850-58c1cc0c3da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fcf895c-ddfd-4477-a850-58c1cc0c3da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1680668048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ad458-e611-4a65-a5ca-e213a4209405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945251073a7a4594bf97762a886a378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:26Z,use_quota=True,user_id='faf5d0987ed144d8bf7824d44a5f4a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d438c9-199e-45b7-9011-38a1b33ea774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d438c9-199e-45b7-9011-38a1b33ea774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de27dfbc-43fe-4d7b-b032-dfbffbede83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:26 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de27dfbc-43fe-4d7b-b032-dfbffbede83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438ad458-e611-4a65-a5ca-e213a4209405', 'volume_name': 'volume-438ad458-e611-4a65-a5ca-e213a4209405', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545d9852-523a-4186-9de5-986c79376292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (545d9852-523a-4186-9de5-986c79376292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dc11c2-01e2-406a-a6de-43962d4c7e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:26 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Volume 438ad458-e611-4a65-a5ca-e213a4209405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438ad458-e611-4a65-a5ca-e213a4209405', 'volume_size': 1} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7" returned: 0 in 0.860s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1680668048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ad458-e611-4a65-a5ca-e213a4209405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='945251073a7a4594bf97762a886a378e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:26Z,use_quota=True,user_id='faf5d0987ed144d8bf7824d44a5f4a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Creating volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:58:26 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad6b7fe-9e37-46e1-828d-6e0898c3a662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb68e9af-9103-4cbc-bea3-263050a698a7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:26 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 1073741824 Jun 19 23:58:26 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5483b15-52c6-47ce-8f6b-2dc023114dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:26 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Volume volume-fb68e9af-9103-4cbc-bea3-263050a698a7 (fb68e9af-9103-4cbc-bea3-263050a698a7): created successfully Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5483b15-52c6-47ce-8f6b-2dc023114dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Flow 'volume_create_manager' (26394b10-8764-4f59-8fac-fd5ce8138c8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:26 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-59f41cd7-dd4b-4b4f-a8ac-f3d6a98cb78b tempest-VolumesTransfersV355Test-307791666 None] Created volume successfully. Jun 19 23:58:27 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 1073741824" returned: 0 in 0.826s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:27 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 Jun 19 23:58:27 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-df01a286-ce13-4278-8587-b2fa8f76f82b req-480332a8-070f-447f-bf7a-83d1106f655c tempest-AttachVolumeNegativeTest-2045992055 None] Terminate volume connection completed successfully. Jun 19 23:58:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-df01a286-ce13-4278-8587-b2fa8f76f82b req-480332a8-070f-447f-bf7a-83d1106f655c tempest-AttachVolumeNegativeTest-2045992055 None] Deleting attachment b030a420-df84-40c1-8aa3-00fef46f26dd. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:58:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c82e0d56-561a-4fff-99bb-1ae3faa48e03 tempest-VolumesTransfersV355Test-291008522 None] Transfer volume completed successfully. Jun 19 23:58:27 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405" returned: 0 in 0.707s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:58:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48dc11c2-01e2-406a-a6de-43962d4c7e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438ad458-e611-4a65-a5ca-e213a4209405', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2482ae03-19b6-483f-afc9-10753afb0cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:28 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Volume volume-438ad458-e611-4a65-a5ca-e213a4209405 (438ad458-e611-4a65-a5ca-e213a4209405): created successfully Jun 19 23:58:28 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2482ae03-19b6-483f-afc9-10753afb0cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:28 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Flow 'volume_create_manager' (32e4ab56-cb7e-4d9e-8e58-5fc0019831ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:28 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3432214f-dc20-4e4e-91f8-f8634d9c3c9c tempest-SnapshotsActionsTest-754052005 None] Created volume successfully. Jun 19 23:58:28 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.809s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 8 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Creating offline snapshot 14d4a58d-1a01-4646-8c8f-68f9f85acf8c of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a37d9f-b30a-47df-be93-75ef4ff2a7da]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:28 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 Jun 19 23:58:28 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Acquiring lock "cinder-fb68e9af-9103-4cbc-bea3-263050a698a7-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Lock "cinder-fb68e9af-9103-4cbc-bea3-263050a698a7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Acquiring lock "cinder-quobyte-fb68e9af-9103-4cbc-bea3-263050a698a7" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Lock "cinder-quobyte-fb68e9af-9103-4cbc-bea3-263050a698a7" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:29 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbdfba0-1156-4769-98e5-bb9e72bef708]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:29 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 Jun 19 23:58:29 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:29 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405" returned: 0 in 0.853s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:29 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c 1G Jun 19 23:58:29 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:30 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7" returned: 0 in 0.911s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:30 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7 Jun 19 23:58:30 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:30 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c 1G" returned: 0 in 0.958s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:30 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:58:30 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:30 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fb68e9af-9103-4cbc-bea3-263050a698a7" returned: 0 in 0.827s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Lock "cinder-quobyte-fb68e9af-9103-4cbc-bea3-263050a698a7" released by "delete_volume" :: held 1.791s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Created reservations ['ba57d457-fc8c-43d3-a2c6-8d89c81aac59', '42dff498-5f2b-4ae9-9048-984eb9d60aa7', '4616dc2b-b988-4928-9973-5194e69f0846', '124df98b-b646-421a-898f-beb41f4cccc4'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:31 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:31 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:31 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 0.858s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:31 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c is being set with open permissions: ugo+rw Jun 19 23:58:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:31 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:58:31 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:32 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.379s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Deleted volume successfully. Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e5f12eae-c8ff-4b9d-922e-dcbeac228d87 tempest-VolumesTransfersV355Test-1006716024 None] Lock "cinder-fb68e9af-9103-4cbc-bea3-263050a698a7-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:32 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 1.261s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:58:32 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.info Jun 19 23:58:32 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Flow 'volume_create_manager' (285f4f7c-becc-47b2-aa40-39d6c357a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167d3468-3453-44fc-b0ad-cbd8a9252a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167d3468-3453-44fc-b0ad-cbd8a9252a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1816754763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd74cfb-32e5-4bef-8bb3-aa88671e8d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441458615ea24867b930b6b6165bf037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:33Z,use_quota=True,user_id='960cfe32649c4267b2ca94318082b52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73aedef8-a376-49aa-9ae1-452adde824c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73aedef8-a376-49aa-9ae1-452adde824c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64f92d0-8a0b-400f-bbcd-a3563689691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64f92d0-8a0b-400f-bbcd-a3563689691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd74cfb-32e5-4bef-8bb3-aa88671e8d66', 'volume_name': 'volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645a561e-b686-4935-a181-9c3fdc6f7187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645a561e-b686-4935-a181-9c3fdc6f7187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fea9851-2eca-415c-a39a-f6151ad4148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:33 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Volume cdd74cfb-32e5-4bef-8bb3-aa88671e8d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66', 'volume_size': 1} Jun 19 23:58:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:33 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.info" returned: 0 in 0.760s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:33 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.info is being set with open permissions: ugo+rw Jun 19 23:58:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:33 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.info Jun 19 23:58:33 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:34 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.info" returned: 0 in 0.834s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.663s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.490s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1816754763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd74cfb-32e5-4bef-8bb3-aa88671e8d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='441458615ea24867b930b6b6165bf037',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:58:33Z,use_quota=True,user_id='960cfe32649c4267b2ca94318082b52d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Creating volume cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:58:34 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:58:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:34 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 1073741824 Jun 19 23:58:34 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-890e0bb8-c63e-4ec8-9775-d41b6733f9cc tempest-SnapshotsActionsTest-754052005 None] Create snapshot completed successfully Jun 19 23:58:35 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 1073741824" returned: 0 in 0.885s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:35 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 Jun 19 23:58:35 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:36 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66" returned: 0 in 0.694s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.441s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fea9851-2eca-415c-a39a-f6151ad4148f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d0ac9c-ec4c-426e-bdbd-e28e75ac640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Creating offline snapshot 9b2d944e-f1b5-42c2-8ef9-624f3340b152 of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 23:58:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Volume volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 (cdd74cfb-32e5-4bef-8bb3-aa88671e8d66): created successfully Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d0ac9c-ec4c-426e-bdbd-e28e75ac640f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Flow 'volume_create_manager' (285f4f7c-becc-47b2-aa40-39d6c357a827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ec9ba3-f463-443c-baef-3369150fadd5]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:36 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1b80dd92-7a2c-4277-b3fe-b32e915311ba tempest-VolumesTransfersV355Test-307791666 None] Created volume successfully. Jun 19 23:58:36 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:58:36 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:37 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 0.800s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:37 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 1G Jun 19 23:58:37 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Acquiring lock "cinder-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Lock "cinder-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Acquiring lock "cinder-quobyte-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Lock "cinder-quobyte-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f32a45-a24e-4e06-bf03-eba02093c859]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:37 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 Jun 19 23:58:37 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:37 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 1G" returned: 0 in 0.924s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:38 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 Jun 19 23:58:38 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:38 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66" returned: 0 in 0.811s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:38 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66 Jun 19 23:58:38 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:38 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152" returned: 0 in 0.750s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:38 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 is being set with open permissions: ugo+rw Jun 19 23:58:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:38 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 Jun 19 23:58:38 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:39 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66" returned: 0 in 0.842s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Lock "cinder-quobyte-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66" released by "delete_volume" :: held 1.703s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=105,cinder:UPDATE=107,cinder:INSERT=19,cinder:DELETE=4 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Created reservations ['fc5ed338-5b3f-4eea-846f-a3706709b8bc', '4fbcde9b-02b2-473a-93e6-df7f8c7d3fe8', 'c9c36adf-0c19-4bb9-902f-8192ed93edd3', '5a11594c-c5b9-463d-9282-1a1919dd7ce0'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:39 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:39 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:39 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152" returned: 0 in 0.857s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.504s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "cinder-dd268a87-b9ad-4a5f-a548-95b66a2ae586-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-dd268a87-b9ad-4a5f-a548-95b66a2ae586-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-01ea7211-f104-423c-bd46-764054635584 tempest-SnapshotsActionsTest-754052005 None] Create snapshot completed successfully Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "cinder-quobyte-dd268a87-b9ad-4a5f-a548-95b66a2ae586" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-quobyte-dd268a87-b9ad-4a5f-a548-95b66a2ae586" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3e9a40-90e7-416e-9de6-fbb7d9a2e22b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:39 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 Jun 19 23:58:39 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-9b2d944e-f1b5-42c2-8ef9-624f3340b152-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-9b2d944e-f1b5-42c2-8ef9-624f3340b152-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-quobyte-9b2d944e-f1b5-42c2-8ef9-624f3340b152" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-9b2d944e-f1b5-42c2-8ef9-624f3340b152" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Deleting offline snapshot 9b2d944e-f1b5-42c2-8ef9-624f3340b152 of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] snapshot_file for this snap is: volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35d0a03-ba46-428f-9345-c62a087e797d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:40 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.902s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Deleted volume successfully. Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7808ddd8-623c-4077-bfc7-2fdcad4885f4 tempest-VolumesTransfersV355Test-1006716024 None] Lock "cinder-cdd74cfb-32e5-4bef-8bb3-aa88671e8d66-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:40 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 Jun 19 23:58:40 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:40 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586" returned: 0 in 0.978s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:40 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586 Jun 19 23:58:40 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:41 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152" returned: 0 in 0.964s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efc30dd-57c6-4d4b-a7cc-efc666cd6af4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:41 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:58:41 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:41 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-dd268a87-b9ad-4a5f-a548-95b66a2ae586" returned: 0 in 0.799s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-quobyte-dd268a87-b9ad-4a5f-a548-95b66a2ae586" released by "delete_volume" :: held 1.835s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Created reservations ['d17d88d9-c97b-49a3-8e45-fe3f02f23b2c', '756ae71d-1107-4743-9ba9-c0271f8a084e', '463261ba-0e9a-4f1d-a251-23ab7c0b1764', '02f8fda8-c1c7-404b-8018-42aa3ac35d57'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:41 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:41 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "cinder-705ca32f-72bb-4752-b2b2-07a0acf74459-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:42 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 1.050s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-705ca32f-72bb-4752-b2b2-07a0acf74459-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:42 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 Jun 19 23:58:42 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "cinder-quobyte-705ca32f-72bb-4752-b2b2-07a0acf74459" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-quobyte-705ca32f-72bb-4752-b2b2-07a0acf74459" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7357b5df-9e6a-4d80-a4a6-8cfe3a2191d7]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:42 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 Jun 19 23:58:42 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:42 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.098s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:42 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Deleted volume successfully. Jun 19 23:58:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ff78c463-92c5-4f23-bdef-33b1e1b51cdc tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-dd268a87-b9ad-4a5f-a548-95b66a2ae586-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:43 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152" returned: 0 in 1.164s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:43 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152 Jun 19 23:58:43 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:43 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459" returned: 0 in 1.103s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:43 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459 Jun 19 23:58:43 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:44 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.9b2d944e-f1b5-42c2-8ef9-624f3340b152" returned: 0 in 1.012s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-9b2d944e-f1b5-42c2-8ef9-624f3340b152" released by "_delete_snapshot" :: held 4.367s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:44 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" released by "delete_snapshot" :: held 4.398s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-705ca32f-72bb-4752-b2b2-07a0acf74459" returned: 0 in 1.051s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-quobyte-705ca32f-72bb-4752-b2b2-07a0acf74459" released by "delete_volume" :: held 2.230s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Created reservations ['cee6ab78-3832-44bd-ba49-3969b038d9af', '4c282632-3586-4197-b7ef-07f7aff85988', 'e98edd94-0d39-4e9a-8ded-db0e1ea776f7', '637cb924-659b-4b8e-b10e-f8dcd1527dfe'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Created reservations ['0d7b9abe-faab-43d6-9b79-97a25efe9c19', '1cbefbb5-eefe-48b8-98ef-66e8d945767b', 'd30d1103-93c9-4f14-bb56-d1a51e90758f', '9e67f133-9dbc-4c46-bd54-f71c9645ffd8'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Delete snapshot completed successfully. Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7b74b70e-8807-4637-92ad-9efb6e334a6c tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-9b2d944e-f1b5-42c2-8ef9-624f3340b152-delete_snapshot" released by "delete_snapshot" :: held 4.770s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:45 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:45 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Creating offline snapshot db732a83-e2e3-4d41-a363-9f7ecf20b2b1 of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 23:58:46 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "cinder-582d638e-e8fb-466e-91c0-f3423d6a8f0d-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.190s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e310b-1d92-43b3-b829-3bd941f0dea9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:46 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Deleted volume successfully. Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-582d638e-e8fb-466e-91c0-f3423d6a8f0d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b7eb2983-59e5-499f-ac65-2cd11a9357af tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-705ca32f-72bb-4752-b2b2-07a0acf74459-delete_volume" released by "delete_volume" :: held 3.954s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "cinder-quobyte-582d638e-e8fb-466e-91c0-f3423d6a8f0d" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-quobyte-582d638e-e8fb-466e-91c0-f3423d6a8f0d" acquired by "delete_volume" :: waited 0.050s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:46 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:58:46 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0deafb0-8371-48f8-8032-06cb04d62913]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:46 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d Jun 19 23:58:46 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:47 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d" returned: 0 in 1.316s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:47 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d Jun 19 23:58:47 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:48 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 2.100s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:58:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:48 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 1G Jun 19 23:58:48 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:48 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-582d638e-e8fb-466e-91c0-f3423d6a8f0d" returned: 0 in 1.158s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-quobyte-582d638e-e8fb-466e-91c0-f3423d6a8f0d" released by "delete_volume" :: held 2.620s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Created reservations ['c5c21f57-55b1-4458-ac91-48ab3253bb97', '9edaee1e-e5ae-4943-b957-6f446b37a9b1', '7db3019b-b9bb-40ea-a4be-93425bb92f8c', '3ef5c0ac-69b7-4102-ae94-66b00700de85'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:49 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:58:49 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:49 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 1G" returned: 0 in 1.657s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:50 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 Jun 19 23:58:50 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:50 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.290s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:50 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:58:50 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Deleted volume successfully. Jun 19 23:58:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-542e811d-4433-4d3f-a1f2-cdbf92d5ad05 tempest-AttachVolumeNegativeTest-2045992055 None] Lock "cinder-582d638e-e8fb-466e-91c0-f3423d6a8f0d-delete_volume" released by "delete_volume" :: held 4.465s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:51 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1" returned: 0 in 1.094s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:51 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 is being set with open permissions: ugo+rw Jun 19 23:58:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:51 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 Jun 19 23:58:51 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:51 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1" returned: 0 in 0.826s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.832s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:58:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b2ef9e80-fc99-44b5-9303-c4df680e32c2 tempest-SnapshotsActionsTest-754052005 None] Create snapshot completed successfully Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-db732a83-e2e3-4d41-a363-9f7ecf20b2b1-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-db732a83-e2e3-4d41-a363-9f7ecf20b2b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-quobyte-db732a83-e2e3-4d41-a363-9f7ecf20b2b1" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-db732a83-e2e3-4d41-a363-9f7ecf20b2b1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Deleting offline snapshot db732a83-e2e3-4d41-a363-9f7ecf20b2b1 of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] snapshot_file for this snap is: volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b600aa-c990-4a7c-b131-035aed7f2f7f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:53 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 Jun 19 23:58:53 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:54 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1" returned: 0 in 1.282s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:58:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[354bf1d2-20d5-47f3-8845-55a2ac1dbe3a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:54 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:58:54 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:55 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 1.145s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:58:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:55 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 Jun 19 23:58:55 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1" returned: 0 in 1.269s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:56 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:56 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1 Jun 19 23:58:56 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:58:57 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Jun 19 23:58:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.db732a83-e2e3-4d41-a363-9f7ecf20b2b1" returned: 0 in 1.151s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:58:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-db732a83-e2e3-4d41-a363-9f7ecf20b2b1" released by "_delete_snapshot" :: held 4.987s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" released by "delete_snapshot" :: held 5.025s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:57 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Created reservations ['4654b559-27d5-4783-a42d-3d4d573f2a6d', '150696fe-0863-44cf-84c0-4ab75f36d4c0', '7d792dbd-f378-4206-8e29-018eaa855254', 'ead457a9-517d-4314-b819-61abcff66b72'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:58:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Delete snapshot completed successfully. Jun 19 23:58:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1bbc85ff-6142-4275-b59f-e4a2ebf83696 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-db732a83-e2e3-4d41-a363-9f7ecf20b2b1-delete_snapshot" released by "delete_snapshot" :: held 5.278s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:58:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:58:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:58:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Creating offline snapshot 030f148b-fa57-4162-9c3e-194648ea9cc5 of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 23:58:58 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a270c-98a8-4df3-9a26-1150a53142aa]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:58:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:58:59 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:58:59 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:00 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 1.333s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:59:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:00 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 1G Jun 19 23:59:00 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:01 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 1G" returned: 0 in 0.975s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:01 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 Jun 19 23:59:01 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:02 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5" returned: 0 in 0.898s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:02 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 is being set with open permissions: ugo+rw Jun 19 23:59:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:02 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 Jun 19 23:59:02 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:02 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5" returned: 0 in 0.779s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.136s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b8fdaa0f-f2ce-41c9-bec8-4ff314a1a3ac tempest-SnapshotsActionsTest-754052005 None] Create snapshot completed successfully Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-030f148b-fa57-4162-9c3e-194648ea9cc5-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-030f148b-fa57-4162-9c3e-194648ea9cc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-quobyte-030f148b-fa57-4162-9c3e-194648ea9cc5" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-030f148b-fa57-4162-9c3e-194648ea9cc5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Deleting offline snapshot 030f148b-fa57-4162-9c3e-194648ea9cc5 of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] snapshot_file for this snap is: volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c2426a-a6ca-4f60-a545-0958ff5e182a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:04 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 Jun 19 23:59:04 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:05 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5" returned: 0 in 0.981s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[367da87e-1a84-4f62-b531-ad943bbce9c4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:05 devstack sudo[109939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:59:05 devstack sudo[109939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Flow 'volume_create_manager' (c870db55-6e0e-465c-a5c4-29cbeba37af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62302cab-8aa2-468f-bf58-fe7a4981d52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62302cab-8aa2-468f-bf58-fe7a4981d52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1974168992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a0f36f-0802-49bc-bdc6-5956d2e8eba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4755a3b1e3034546820cd559cd75af46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:06Z,use_quota=True,user_id='e0748a41c34348dfa597bbd3715a428d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9153a67-bd9c-470c-9dd0-b4323f981a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9153a67-bd9c-470c-9dd0-b4323f981a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a1ae89-09ab-4f9a-8425-e463287961e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a1ae89-09ab-4f9a-8425-e463287961e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a0f36f-0802-49bc-bdc6-5956d2e8eba9', 'volume_name': 'volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462299c1-5dc7-4803-8a2e-587e904c89cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462299c1-5dc7-4803-8a2e-587e904c89cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47922e9a-07f3-4b2e-bdcf-f59a4637020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:05 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Volume 41a0f36f-0802-49bc-bdc6-5956d2e8eba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9', 'volume_size': 1} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1974168992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a0f36f-0802-49bc-bdc6-5956d2e8eba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4755a3b1e3034546820cd559cd75af46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:06Z,use_quota=True,user_id='e0748a41c34348dfa597bbd3715a428d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Creating volume 41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:59:05 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:59:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:05 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 1073741824 Jun 19 23:59:05 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:06 devstack sudo[109939]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 0.832s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:59:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:06 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 Jun 19 23:59:06 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:06 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 1073741824" returned: 0 in 0.988s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:06 devstack sudo[109990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 19 23:59:06 devstack sudo[109990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:07 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5" returned: 0 in 0.922s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:07 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5 Jun 19 23:59:07 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:07 devstack sudo[109990]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 0.763s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47922e9a-07f3-4b2e-bdcf-f59a4637020d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55d95c8-d9cb-4f03-8919-25f52d0acfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:07 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Volume volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 (41a0f36f-0802-49bc-bdc6-5956d2e8eba9): created successfully Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55d95c8-d9cb-4f03-8919-25f52d0acfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Flow 'volume_create_manager' (c870db55-6e0e-465c-a5c4-29cbeba37af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-aea4d79b-0128-47c1-b31c-5ac2b4b02d01 tempest-VolumesActionsTest-1845533677 None] Created volume successfully. Jun 19 23:59:08 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.030f148b-fa57-4162-9c3e-194648ea9cc5" returned: 0 in 1.022s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-030f148b-fa57-4162-9c3e-194648ea9cc5" released by "_delete_snapshot" :: held 3.911s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" released by "delete_snapshot" :: held 3.947s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:08 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Created reservations ['b5198163-e51f-4fdc-8c12-2bbf51cc9255', '6b5c8b71-56c4-4b45-bfbe-635455e4d380', '3be693b5-9959-414b-9967-a2278547bd25', '4bbf739c-1a5e-4a43-89ea-1f7328ae0bf8'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:59:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Delete snapshot completed successfully. Jun 19 23:59:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2b917ae6-1468-4fcd-81bb-b4d6e9285802 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-030f148b-fa57-4162-9c3e-194648ea9cc5-delete_snapshot" released by "delete_snapshot" :: held 4.126s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Creating offline snapshot 28b57017-5155-4606-947e-a688e7a93f27 of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 23:59:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fdf8da-2aee-4d39-8f87-6a3567a78416]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:09 devstack sudo[110073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:59:09 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:09 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 0.859s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:59:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:09 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 1G Jun 19 23:59:09 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:10 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 1G" returned: 0 in 0.955s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:10 devstack sudo[110174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 Jun 19 23:59:10 devstack sudo[110174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:11 devstack sudo[110174]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27" returned: 0 in 0.836s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:11 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 is being set with open permissions: ugo+rw Jun 19 23:59:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:11 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 Jun 19 23:59:11 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:12 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27" returned: 0 in 0.852s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.642s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:12 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-73a3dc84-29ad-46f4-87af-39ef66d80fa5 tempest-SnapshotsActionsTest-754052005 None] Create snapshot completed successfully Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-28b57017-5155-4606-947e-a688e7a93f27-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-28b57017-5155-4606-947e-a688e7a93f27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Acquiring lock "cinder-quobyte-28b57017-5155-4606-947e-a688e7a93f27" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-28b57017-5155-4606-947e-a688e7a93f27" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Deleting offline snapshot 28b57017-5155-4606-947e-a688e7a93f27 of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] snapshot_file for this snap is: volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b9c033-5486-4800-a06d-b14cdce95e1c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:13 devstack sudo[110259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 Jun 19 23:59:13 devstack sudo[110259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:14 devstack sudo[110259]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27" returned: 0 in 0.970s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:59:14 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[747ce74d-923b-4fdf-b460-467d0c27963e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-3d803393-d261-4869-bc29-f486773cd909 req-accbcf75-7ccc-45db-b328-d6598f6fc514 tempest-AttachVolumeTestJSON-148826376 None] Terminate volume connection completed successfully. Jun 19 23:59:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-3d803393-d261-4869-bc29-f486773cd909 req-accbcf75-7ccc-45db-b328-d6598f6fc514 tempest-AttachVolumeTestJSON-148826376 None] Deleting attachment 563a0ece-3110-456c-95dd-dfa3787b9fbb. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 23:59:14 devstack sudo[110300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:59:14 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 1.043s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:15 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:59:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:15 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:15 devstack sudo[110338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 Jun 19 23:59:15 devstack sudo[110338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:16 devstack sudo[110338]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27" returned: 0 in 1.067s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:16 devstack sudo[110396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27 Jun 19 23:59:16 devstack sudo[110396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:17 devstack sudo[110396]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.28b57017-5155-4606-947e-a688e7a93f27" returned: 0 in 0.713s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-28b57017-5155-4606-947e-a688e7a93f27" released by "_delete_snapshot" :: held 3.932s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" released by "delete_snapshot" :: held 3.964s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Created reservations ['2ce83766-9dab-4178-bb66-c38e885e835a', '0eed4bfa-bc7b-4003-b50d-23aa1a2aa6af', '5308e799-8acb-47b5-b5e3-6e606f8ab2f0', '10064af6-f31e-428b-889f-a1f1c5e292a7'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:59:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Delete snapshot completed successfully. Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a050b437-73fd-4d9e-947b-3a252eb34147 tempest-SnapshotsActionsTest-2080596971 None] Lock "cinder-28b57017-5155-4606-947e-a688e7a93f27-delete_snapshot" released by "delete_snapshot" :: held 4.124s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Flow 'volume_create_manager' (a1a93af1-10cd-4581-9de3-ac91c539bb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff55f946-71ae-44a2-bdd2-00fec7430c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff55f946-71ae-44a2-bdd2-00fec7430c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1224041380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a76336-6ee8-4f1f-9d72-b005dcea5d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee671ed7e3842eeb61800a3d303fcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:17Z,use_quota=True,user_id='25e139b6a13c4561a4455737bea9040d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295bdddf-f6aa-49b0-aa24-32b7bb63cd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (295bdddf-f6aa-49b0-aa24-32b7bb63cd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bb5616-7ab4-43e8-b40a-d4c599ccf12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bb5616-7ab4-43e8-b40a-d4c599ccf12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a76336-6ee8-4f1f-9d72-b005dcea5d8b', 'volume_name': 'volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f3575-c41e-46ab-a72c-4985d304b8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8f3575-c41e-46ab-a72c-4985d304b8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d85e76f-ea5f-4a87-925c-8580b01e3881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:17 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Volume d7a76336-6ee8-4f1f-9d72-b005dcea5d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b', 'volume_size': 1} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1224041380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a76336-6ee8-4f1f-9d72-b005dcea5d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee671ed7e3842eeb61800a3d303fcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:17Z,use_quota=True,user_id='25e139b6a13c4561a4455737bea9040d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Creating volume d7a76336-6ee8-4f1f-9d72-b005dcea5d8b {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:59:17 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:59:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:17 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b 1073741824 Jun 19 23:59:17 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "cinder-14d4a58d-1a01-4646-8c8f-68f9f85acf8c-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-14d4a58d-1a01-4646-8c8f-68f9f85acf8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "cinder-quobyte-14d4a58d-1a01-4646-8c8f-68f9f85acf8c" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-quobyte-14d4a58d-1a01-4646-8c8f-68f9f85acf8c" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Deleting offline snapshot 14d4a58d-1a01-4646-8c8f-68f9f85acf8c of volume 438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] snapshot_file for this snap is: volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[afed9088-fe00-456e-b099-1ffbaeadfb9e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:18 devstack sudo[110493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:59:18 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:18 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b 1073741824" returned: 0 in 1.404s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:18 devstack sudo[110518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b Jun 19 23:59:19 devstack sudo[110518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:19 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 0.877s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-438ad458-e611-4a65-a5ca-e213a4209405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c09f00-6dc0-45b6-8f66-faf2b86c285e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:19 devstack sudo[110533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 Jun 19 23:59:19 devstack sudo[110533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:19 devstack sudo[110518]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b" returned: 0 in 0.758s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=87,cinder:SELECT=75,cinder:DELETE=12,cinder:INSERT=20 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d85e76f-ea5f-4a87-925c-8580b01e3881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b939ab-3c6c-4436-9ac6-bd0e6aac2bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:19 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Volume volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b (d7a76336-6ee8-4f1f-9d72-b005dcea5d8b): created successfully Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b939ab-3c6c-4436-9ac6-bd0e6aac2bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Flow 'volume_create_manager' (a1a93af1-10cd-4581-9de3-ac91c539bb32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:19 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c49f1eb8-016c-47b4-bd65-430d096f0ef4 tempest-VolumeQuotasAdminTestJSON-933018880 None] Created volume successfully. Jun 19 23:59:20 devstack sudo[110533]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405" returned: 0 in 0.853s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:20 devstack sudo[110575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:59:20 devstack sudo[110575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Acquiring lock "cinder-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "cinder-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Acquiring lock "cinder-quobyte-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "cinder-quobyte-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea41956-c758-4859-9582-2b305bacc0f7]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:20 devstack sudo[110598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b Jun 19 23:59:20 devstack sudo[110598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:20 devstack sudo[110575]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 0.807s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:21 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c Jun 19 23:59:21 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:21 devstack sudo[110598]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b" returned: 0 in 0.810s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:21 devstack sudo[110636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b Jun 19 23:59:21 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:21 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405.14d4a58d-1a01-4646-8c8f-68f9f85acf8c" returned: 0 in 0.699s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-quobyte-14d4a58d-1a01-4646-8c8f-68f9f85acf8c" released by "_delete_snapshot" :: held 3.406s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" released by "delete_snapshot" :: held 3.464s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:21 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Created reservations ['4039135e-fe57-4cb7-a2c9-21274cd11fc3', 'dd95c8aa-2146-4c26-ba53-64c0b0257012', '7547450f-21d5-4bb5-bfa7-e072b99395bf', '08bb57cf-b76f-4bd3-9bfb-37192e3352fc'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:59:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Delete snapshot completed successfully. Jun 19 23:59:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ba3c6504-f967-4104-a7b9-3ce721bbfc4f tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-14d4a58d-1a01-4646-8c8f-68f9f85acf8c-delete_snapshot" released by "delete_snapshot" :: held 3.689s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:22 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b" returned: 0 in 0.948s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "cinder-quobyte-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b" released by "delete_volume" :: held 1.825s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "cinder-438ad458-e611-4a65-a5ca-e213a4209405-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-438ad458-e611-4a65-a5ca-e213a4209405-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Created reservations ['960fcefc-1394-411b-83e1-3e33eb44b2fd', 'd162958b-870e-4f99-ab6f-a85b84d62a80', '43db58c5-232e-45a3-b64f-4d70df11af56', '0ae176f8-6367-42bc-845a-d42883c33fe6'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" acquired by "delete_volume" :: waited 0.049s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3c6819-e1d3-4684-b2d9-163d0e3493e5]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:23 devstack sudo[110770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:59:23 devstack sudo[110770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:23 devstack sudo[110764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 Jun 19 23:59:23 devstack sudo[110764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:24 devstack sudo[110770]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.982s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:59:24 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Deleted volume successfully. Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-49dafa72-92b8-4662-bb8d-eb0a7b4e0ce2 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "cinder-d7a76336-6ee8-4f1f-9d72-b005dcea5d8b-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:24 devstack sudo[110764]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405" returned: 0 in 1.200s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:24 devstack sudo[110825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405 Jun 19 23:59:24 devstack sudo[110825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Flow 'volume_create_manager' (973b66f3-a87d-407f-9253-2c59505a7dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c824a76c-a91a-42e9-9eae-70c95f5c8b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c824a76c-a91a-42e9-9eae-70c95f5c8b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-926983215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7413bd-ff31-47f3-9d94-11ff0c1a083b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee671ed7e3842eeb61800a3d303fcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:25Z,use_quota=True,user_id='25e139b6a13c4561a4455737bea9040d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde76152-368d-4593-9e33-a39f3963b296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde76152-368d-4593-9e33-a39f3963b296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef282e8-256c-42b7-80f1-92b564408331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef282e8-256c-42b7-80f1-92b564408331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7413bd-ff31-47f3-9d94-11ff0c1a083b', 'volume_name': 'volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd56231-b819-493a-b912-21bb738bcb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fd56231-b819-493a-b912-21bb738bcb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a086d6-ecfa-4a7d-ae60-55c2a4d42cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:25 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Volume 7b7413bd-ff31-47f3-9d94-11ff0c1a083b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b', 'volume_size': 1} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-926983215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7413bd-ff31-47f3-9d94-11ff0c1a083b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee671ed7e3842eeb61800a3d303fcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:25Z,use_quota=True,user_id='25e139b6a13c4561a4455737bea9040d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Creating volume 7b7413bd-ff31-47f3-9d94-11ff0c1a083b {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:59:25 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:25 devstack sudo[110857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b 1073741824 Jun 19 23:59:25 devstack sudo[110857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:25 devstack sudo[110825]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-438ad458-e611-4a65-a5ca-e213a4209405" returned: 0 in 1.046s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-quobyte-438ad458-e611-4a65-a5ca-e213a4209405" released by "delete_volume" :: held 2.326s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Created reservations ['b810c6fd-45f8-421a-a9a0-ecd585fdd281', '2de70179-e8f0-4295-aec3-7c38ed09a650', '3c3815cd-a040-48f1-af24-5bc6da913c16', '30769157-eef6-4b01-beda-e5104517a2b6'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:25 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:59:25 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:26 devstack sudo[110857]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b 1073741824" returned: 0 in 1.136s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:26 devstack sudo[110902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b Jun 19 23:59:26 devstack sudo[110902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:26 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.126s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:26 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:59:26 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Deleted volume successfully. Jun 19 23:59:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7be94fed-46f6-4016-bc66-91d0beaa0af7 tempest-VolumesActionsTest-1845533677 None] Acquiring lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" by "attach_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1ff36de6-914c-480d-87b3-56861304c2d8 tempest-SnapshotsActionsTest-754052005 None] Lock "cinder-438ad458-e611-4a65-a5ca-e213a4209405-delete_volume" released by "delete_volume" :: held 3.806s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7be94fed-46f6-4016-bc66-91d0beaa0af7 tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" acquired by "attach_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:26 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7be94fed-46f6-4016-bc66-91d0beaa0af7 tempest-VolumesActionsTest-1845533677 None] Attaching volume 41a0f36f-0802-49bc-bdc6-5956d2e8eba9 to instance a0ec7ecf-fb01-4941-a29b-5c3d0d0856d4 at mountpoint /dev/vdb on host None. Jun 19 23:59:26 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7be94fed-46f6-4016-bc66-91d0beaa0af7 tempest-VolumesActionsTest-1845533677 None] Attach volume completed successfully. Jun 19 23:59:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7be94fed-46f6-4016-bc66-91d0beaa0af7 tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" released by "attach_volume" :: held 0.159s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1c600d9f-01c9-4adc-8b26-471032d0fb92 tempest-VolumesActionsTest-1845533677 None] Acquiring lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-detach_volume" by "detach_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1c600d9f-01c9-4adc-8b26-471032d0fb92 tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1c600d9f-01c9-4adc-8b26-471032d0fb92 tempest-VolumesActionsTest-1845533677 None] Detaching volume 41a0f36f-0802-49bc-bdc6-5956d2e8eba9 from instance a0ec7ecf-fb01-4941-a29b-5c3d0d0856d4. Jun 19 23:59:27 devstack sudo[110902]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b" returned: 0 in 1.086s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] <== create_volume: return (2340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.348s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a086d6-ecfa-4a7d-ae60-55c2a4d42cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e2625f-4a41-4e99-a7e3-558a5d00e993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:27 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Volume volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b (7b7413bd-ff31-47f3-9d94-11ff0c1a083b): created successfully Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95e2625f-4a41-4e99-a7e3-558a5d00e993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Flow 'volume_create_manager' (973b66f3-a87d-407f-9253-2c59505a7dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1c600d9f-01c9-4adc-8b26-471032d0fb92 tempest-VolumesActionsTest-1845533677 None] Detach volume completed successfully. Jun 19 23:59:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8f3a7db8-5eda-4d41-8f35-3889fae1eab5 tempest-VolumeQuotasAdminTestJSON-933018880 None] Created volume successfully. Jun 19 23:59:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1c600d9f-01c9-4adc-8b26-471032d0fb92 tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:59:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:28 devstack sudo[110969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:59:28 devstack sudo[110969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:29 devstack sudo[110969]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.054s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:59:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 23:59:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 8 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 23:59:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 23:59:29 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-307417a9-9de5-457a-810b-99f5e6125514 tempest-VolumeQuotasAdminTestJSON-656415682 None] Transfer volume completed successfully. Jun 19 23:59:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Acquiring lock "cinder-7b7413bd-ff31-47f3-9d94-11ff0c1a083b-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Lock "cinder-7b7413bd-ff31-47f3-9d94-11ff0c1a083b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Acquiring lock "cinder-quobyte-7b7413bd-ff31-47f3-9d94-11ff0c1a083b" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Lock "cinder-quobyte-7b7413bd-ff31-47f3-9d94-11ff0c1a083b" acquired by "delete_volume" :: waited 0.040s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:31 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3fc98c-c1fb-4321-b01d-8e1c0b655eec]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:31 devstack sudo[111217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b Jun 19 23:59:31 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:32 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b" returned: 0 in 1.296s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:32 devstack sudo[111265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b Jun 19 23:59:32 devstack sudo[111265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:33 devstack sudo[111265]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7b7413bd-ff31-47f3-9d94-11ff0c1a083b" returned: 0 in 0.819s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Lock "cinder-quobyte-7b7413bd-ff31-47f3-9d94-11ff0c1a083b" released by "delete_volume" :: held 2.233s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Created reservations ['588ab7eb-ebf5-41c6-9a63-de39b66e2b17', '95208814-978b-4e00-9bc1-efff2a7280cf', '042c4bcc-a6cf-4d69-8f66-55316874e92b', 'd46b7b8c-06f6-47ec-b72d-ccfa908ee673'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:33 devstack sudo[111302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:59:33 devstack sudo[111302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:34 devstack sudo[111302]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.944s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:34 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:59:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Deleted volume successfully. Jun 19 23:59:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-578ed07e-0779-4ef2-9d72-44a2e3bbaed8 tempest-VolumeQuotasAdminTestJSON-909658899 None] Lock "cinder-7b7413bd-ff31-47f3-9d94-11ff0c1a083b-delete_volume" released by "delete_volume" :: held 3.667s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:43 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=84,cinder:INSERT=24,cinder:UPDATE=103,cinder:DELETE=4 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Flow 'volume_create_manager' (9523a3b5-f73e-483c-b962-de0fd681bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e12a58-c6c2-4977-a2e6-190381701213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e12a58-c6c2-4977-a2e6-190381701213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1552411298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d519a9ba-d97d-4b92-b625-d993b19c753e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7254c9cca14249408101f513d887f3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:44Z,use_quota=True,user_id='a7454fe848024abf984ee27c91837bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e8ce50-c303-4631-8674-07ecfc6e0f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e8ce50-c303-4631-8674-07ecfc6e0f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77516937-1475-4494-823a-615655758da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77516937-1475-4494-823a-615655758da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd519a9ba-d97d-4b92-b625-d993b19c753e', 'volume_name': 'volume-d519a9ba-d97d-4b92-b625-d993b19c753e', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3d6d4a-47ef-457e-9a94-d149dc4769b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3d6d4a-47ef-457e-9a94-d149dc4769b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eeb2ff-50f6-4428-8191-775f6a2f627c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Volume d519a9ba-d97d-4b92-b625-d993b19c753e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d519a9ba-d97d-4b92-b625-d993b19c753e', 'volume_size': 1} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1552411298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d519a9ba-d97d-4b92-b625-d993b19c753e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7254c9cca14249408101f513d887f3a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:44Z,use_quota=True,user_id='a7454fe848024abf984ee27c91837bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Creating volume d519a9ba-d97d-4b92-b625-d993b19c753e {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:59:44 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:44 devstack sudo[111620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e 1073741824 Jun 19 23:59:44 devstack sudo[111620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Flow 'volume_create_manager' (db7eb308-0a52-4448-b54c-736c2b6936b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7760b96-18ef-4838-9d9b-67c13812f139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7760b96-18ef-4838-9d9b-67c13812f139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1004810481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fd4a35-80d2-44af-b3aa-be559fd2cba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2809743cbd43dbba3159ef725e5561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:44Z,use_quota=True,user_id='837fe8340d5a4582b360139f77e51e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(379737cf-7155-47d8-a49b-254bf714570a),volume_type_id=379737cf-7155-47d8-a49b-254bf714570a)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbf996b-ba3b-4f7e-83c5-79e6cec30922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbf996b-ba3b-4f7e-83c5-79e6cec30922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d849b4-c373-4abc-af99-d3ff3014a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d849b4-c373-4abc-af99-d3ff3014a7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5fd4a35-80d2-44af-b3aa-be559fd2cba3', 'volume_name': 'volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0432d44b-ca63-45fe-b8c2-fe66a7ea2bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0432d44b-ca63-45fe-b8c2-fe66a7ea2bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f84f057-8fef-4211-8edd-65c52cff4555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Volume c5fd4a35-80d2-44af-b3aa-be559fd2cba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3', 'volume_size': 1} Jun 19 23:59:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:45 devstack sudo[111620]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e 1073741824" returned: 0 in 1.173s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:45 devstack sudo[111673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e Jun 19 23:59:45 devstack sudo[111673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:46 devstack sudo[111673]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e" returned: 0 in 0.710s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.761s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T21:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1004810481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5fd4a35-80d2-44af-b3aa-be559fd2cba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2809743cbd43dbba3159ef725e5561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T21:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T21:59:44Z,use_quota=True,user_id='837fe8340d5a4582b360139f77e51e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(379737cf-7155-47d8-a49b-254bf714570a),volume_type_id=379737cf-7155-47d8-a49b-254bf714570a)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Creating volume c5fd4a35-80d2-44af-b3aa-be559fd2cba3 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 23:59:46 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eeb2ff-50f6-4428-8191-775f6a2f627c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d519a9ba-d97d-4b92-b625-d993b19c753e', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:46 devstack sudo[111701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 1073741824 Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be88ed32-2538-42ca-9569-934f91cd5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:46 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:46 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Volume volume-d519a9ba-d97d-4b92-b625-d993b19c753e (d519a9ba-d97d-4b92-b625-d993b19c753e): created successfully Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be88ed32-2538-42ca-9569-934f91cd5e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Flow 'volume_create_manager' (9523a3b5-f73e-483c-b962-de0fd681bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:46 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-5341693b-84e7-4a21-97f1-39c22d3ffb72 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Created volume successfully. Jun 19 23:59:47 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 1073741824" returned: 0 in 0.873s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:47 devstack sudo[111749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 Jun 19 23:59:47 devstack sudo[111749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:47 devstack sudo[111749]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3" returned: 0 in 0.672s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.392s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Creating offline snapshot ad89f686-79a3-4ab8-8f51-f25ba4d1e71f of volume d519a9ba-d97d-4b92-b625-d993b19c753e {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f84f057-8fef-4211-8edd-65c52cff4555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2cabd0-e5b0-4998-98f1-058f4a022649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[452e41ff-16b0-4a2b-ab40-446d716620c8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:47 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Volume volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 (c5fd4a35-80d2-44af-b3aa-be559fd2cba3): created successfully Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad2cabd0-e5b0-4998-98f1-058f4a022649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 23:59:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Flow 'volume_create_manager' (db7eb308-0a52-4448-b54c-736c2b6936b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 23:59:47 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-87e80030-09f9-46cd-b205-e7f1e3fcee7f tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Created volume successfully. Jun 19 23:59:47 devstack sudo[111773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e Jun 19 23:59:47 devstack sudo[111773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:48 devstack sudo[111773]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e" returned: 0 in 0.796s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:48 devstack sudo[111802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f 1G Jun 19 23:59:48 devstack sudo[111802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:48 devstack sudo[111804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:59:48 devstack sudo[111804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:49 devstack sudo[111804]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.663s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:49 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:59:49 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e819e137-38f3-41b1-8b48-bca4ec8471c5 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Retype volume completed successfully. Jun 19 23:59:49 devstack sudo[111802]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f 1G" returned: 0 in 0.819s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d519a9ba-d97d-4b92-b625-d993b19c753e -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:49 devstack sudo[111836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d519a9ba-d97d-4b92-b625-d993b19c753e -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f Jun 19 23:59:49 devstack sudo[111836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Acquiring lock "cinder-c5fd4a35-80d2-44af-b3aa-be559fd2cba3-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "cinder-c5fd4a35-80d2-44af-b3aa-be559fd2cba3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Acquiring lock "cinder-quobyte-c5fd4a35-80d2-44af-b3aa-be559fd2cba3" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "cinder-quobyte-c5fd4a35-80d2-44af-b3aa-be559fd2cba3" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c55afa-dbd3-4c9e-be7c-0ed249d8fe8a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:50 devstack sudo[111836]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d519a9ba-d97d-4b92-b625-d993b19c753e -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f" returned: 0 in 0.717s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:50 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f is being set with open permissions: ugo+rw Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:50 devstack sudo[111864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 Jun 19 23:59:50 devstack sudo[111864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:50 devstack sudo[111868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f Jun 19 23:59:50 devstack sudo[111868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:50 devstack sudo[111864]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3" returned: 0 in 0.779s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:50 devstack sudo[111896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3 Jun 19 23:59:50 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:50 devstack sudo[111868]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f" returned: 0 in 0.720s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:50 devstack sudo[111899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.info Jun 19 23:59:50 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:51 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c5fd4a35-80d2-44af-b3aa-be559fd2cba3" returned: 0 in 0.772s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "cinder-quobyte-c5fd4a35-80d2-44af-b3aa-be559fd2cba3" released by "delete_volume" :: held 1.612s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:51 devstack cinder-volume[93391]: WARNING cinder.quota [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:59:51 devstack cinder-volume[93391]: WARNING cinder.quota [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Created reservations ['739d8d7a-6863-4a1a-a3f2-53e31142e140', '1b98d664-d1ca-4049-beee-783dfddcac8d', 'be783bfa-1457-481d-bf65-a50d769d53e9', '40bf919b-c002-4443-bc3c-b6515fdf1caf'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 23:59:51 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.info" returned: 0 in 0.957s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:51 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.info is being set with open permissions: ugo+rw Jun 19 23:59:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:51 devstack sudo[111946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 19 23:59:51 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:51 devstack sudo[111947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.info Jun 19 23:59:51 devstack sudo[111947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:53 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.541s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:53 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 23:59:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Deleted volume successfully. Jun 19 23:59:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2e58ac13-20ea-404d-a81a-0e8a17052cb9 tempest-VolumeRetypeWithoutMigrationTest-343036728 None] Lock "cinder-c5fd4a35-80d2-44af-b3aa-be559fd2cba3-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:53 devstack sudo[111947]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.info" returned: 0 in 1.684s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.803s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 23:59:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-34e71be5-f2ff-498f-aaa7-f8c38ae58ba7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Create snapshot completed successfully Jun 19 23:59:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "cinder-ad89f686-79a3-4ab8-8f51-f25ba4d1e71f-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-ad89f686-79a3-4ab8-8f51-f25ba4d1e71f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "cinder-quobyte-d519a9ba-d97d-4b92-b625-d993b19c753e" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-quobyte-d519a9ba-d97d-4b92-b625-d993b19c753e" acquired by "delete_snapshot" :: waited 0.059s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "cinder-quobyte-ad89f686-79a3-4ab8-8f51-f25ba4d1e71f" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-quobyte-ad89f686-79a3-4ab8-8f51-f25ba4d1e71f" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Deleting offline snapshot ad89f686-79a3-4ab8-8f51-f25ba4d1e71f of volume d519a9ba-d97d-4b92-b625-d993b19c753e {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] snapshot_file for this snap is: volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[033ae09b-92e8-4d52-b571-ab1b00fd2d18]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:56 devstack sudo[112179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f Jun 19 23:59:56 devstack sudo[112179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e64d615-ae0f-46bb-97ad-3cf06b4a28f0 tempest-VolumesActionsTest-1845533677 None] Acquiring lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" by "attach_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e64d615-ae0f-46bb-97ad-3cf06b4a28f0 tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" acquired by "attach_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3e64d615-ae0f-46bb-97ad-3cf06b4a28f0 tempest-VolumesActionsTest-1845533677 None] Attaching volume 41a0f36f-0802-49bc-bdc6-5956d2e8eba9 to instance e01912d3-018b-497d-9f1b-21b55d62d13b at mountpoint /dev/vdb on host None. Jun 19 23:59:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3e64d615-ae0f-46bb-97ad-3cf06b4a28f0 tempest-VolumesActionsTest-1845533677 None] Attach volume completed successfully. Jun 19 23:59:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e64d615-ae0f-46bb-97ad-3cf06b4a28f0 tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" released by "attach_volume" :: held 0.132s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:57 devstack sudo[112179]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f" returned: 0 in 1.352s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d519a9ba-d97d-4b92-b625-d993b19c753e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 23:59:57 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff84cf3-044d-4b5d-b1a9-18d33752dd9a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 23:59:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:57 devstack sudo[112229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e Jun 19 23:59:57 devstack sudo[112229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 23:59:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97220521-a471-46a3-aad0-cec72e4c03e1 tempest-VolumesActionsTest-1845533677 None] Acquiring lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-detach_volume" by "detach_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 23:59:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97220521-a471-46a3-aad0-cec72e4c03e1 tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 23:59:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-97220521-a471-46a3-aad0-cec72e4c03e1 tempest-VolumesActionsTest-1845533677 None] Detaching volume 41a0f36f-0802-49bc-bdc6-5956d2e8eba9 from instance e01912d3-018b-497d-9f1b-21b55d62d13b. Jun 19 23:59:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-97220521-a471-46a3-aad0-cec72e4c03e1 tempest-VolumesActionsTest-1845533677 None] Detach volume completed successfully. Jun 19 23:59:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97220521-a471-46a3-aad0-cec72e4c03e1 tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 23:59:59 devstack sudo[112229]: pam_unix(sudo:session): session closed for user root Jun 19 23:59:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e" returned: 0 in 1.441s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 23:59:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 23:59:59 devstack sudo[112284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f Jun 19 23:59:59 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:00 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f" returned: 0 in 1.117s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:00 devstack sudo[112327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f Jun 20 00:00:00 devstack sudo[112327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:01 devstack sudo[112327]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e.ad89f686-79a3-4ab8-8f51-f25ba4d1e71f" returned: 0 in 1.145s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-quobyte-ad89f686-79a3-4ab8-8f51-f25ba4d1e71f" released by "_delete_snapshot" :: held 5.232s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-quobyte-d519a9ba-d97d-4b92-b625-d993b19c753e" released by "delete_snapshot" :: held 5.285s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Created reservations ['79df7ac1-1c07-443f-98b1-574adf2391cc', '2d3a3a40-c93c-4cdc-ba5b-7e6af8d0f7b6', '07bd5761-82d1-42ac-8431-f4027c4f7570', '4c6267ec-6b4d-4460-9c07-7f1b1a6fbe59'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:00:01 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Delete snapshot completed successfully. Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ab254fe-754f-4480-8ced-b6f7c5f5826a tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-ad89f686-79a3-4ab8-8f51-f25ba4d1e71f-delete_snapshot" released by "delete_snapshot" :: held 5.497s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "cinder-d519a9ba-d97d-4b92-b625-d993b19c753e-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-d519a9ba-d97d-4b92-b625-d993b19c753e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "cinder-quobyte-d519a9ba-d97d-4b92-b625-d993b19c753e" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-quobyte-d519a9ba-d97d-4b92-b625-d993b19c753e" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50d9d6d-2b8d-45da-a518-fefe04523389]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:00:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:01 devstack sudo[112480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e Jun 20 00:00:01 devstack sudo[112480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:02 devstack sudo[112480]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e" returned: 0 in 0.965s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:02 devstack sudo[112517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e Jun 20 00:00:02 devstack sudo[112517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:03 devstack sudo[112517]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d519a9ba-d97d-4b92-b625-d993b19c753e" returned: 0 in 0.844s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-quobyte-d519a9ba-d97d-4b92-b625-d993b19c753e" released by "delete_volume" :: held 1.882s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Created reservations ['0225a1ff-f1fc-4860-b620-dd6550f82274', '289a6d7d-f256-4b58-8d6d-846f05445131', '0277ab3e-d593-4a29-a04c-92c542efb779', '4d1a0844-e5a9-4de3-8048-52847b8f669c'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:00:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:03 devstack sudo[112552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:00:03 devstack sudo[112552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:04 devstack sudo[112552]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.034s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:04 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:00:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Deleted volume successfully. Jun 20 00:00:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-25549859-e5cb-44b8-bd8e-a6435c30934c tempest-VolumeSnapshotQuotasNegativeTestJSON-1724686216 None] Lock "cinder-d519a9ba-d97d-4b92-b625-d993b19c753e-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:00:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:00:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:00:10 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b7020f-6568-4c91-9e92-6a8b2da8665f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:00:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:10 devstack sudo[112762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 20 00:00:10 devstack sudo[112762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:11 devstack sudo[112762]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 1.041s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:11 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d93fe62-9187-4951-8300-c4b0150de90b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:00:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:11 devstack sudo[112836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 20 00:00:11 devstack sudo[112836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:12 devstack sudo[112836]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 0.913s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.e3a86412-322f-4dcc-a4ad-228a798d2eefit6_5jo0.img {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:12 devstack sudo[112870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.e3a86412-322f-4dcc-a4ad-228a798d2eefit6_5jo0.img Jun 20 00:00:12 devstack sudo[112870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Flow 'volume_create_manager' (0c505732-bda8-4b9c-aee2-a1ad0e967058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cbae86-75b1-4add-92b1-8efd9e388cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cbae86-75b1-4add-92b1-8efd9e388cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2117453068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a632d85-8e9e-4539-a94e-09f5766036a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb213bd3ab02408db60d914decb3839a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:00:13Z,use_quota=True,user_id='3349abe13bae49d0b221becbfdd9c895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf8d28e1-66eb-4481-9c98-df310665b350),volume_type_id=cf8d28e1-66eb-4481-9c98-df310665b350)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498f725f-b58f-4e7e-958a-aa8be0e79143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498f725f-b58f-4e7e-958a-aa8be0e79143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c93fa93-d17d-471d-8cbd-5529ea0497c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c93fa93-d17d-471d-8cbd-5529ea0497c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a632d85-8e9e-4539-a94e-09f5766036a9', 'volume_name': 'volume-1a632d85-8e9e-4539-a94e-09f5766036a9', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712a5c01-93a7-4cfd-b53c-3f292e3fd610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712a5c01-93a7-4cfd-b53c-3f292e3fd610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0d9a5f-1816-4b38-8a97-4e6e9ffca833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:13 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Volume 1a632d85-8e9e-4539-a94e-09f5766036a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a632d85-8e9e-4539-a94e-09f5766036a9', 'volume_size': 1} Jun 20 00:00:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:00:19 devstack sudo[112870]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.e3a86412-322f-4dcc-a4ad-228a798d2eefit6_5jo0.img" returned: 0 in 6.478s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[294e8b5e-73ba-41bb-bb6b-d2e10e8f2a70]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:00:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:19 devstack sudo[113106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 20 00:00:19 devstack sudo[113106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:20 devstack sudo[113106]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 1.019s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:20 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.e3a86412-322f-4dcc-a4ad-228a798d2eefit6_5jo0.img {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:00:20 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Converted 1024.00 MB image at 158.04 MB/s Jun 20 00:00:20 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=63,cinder:INSERT=18,cinder:UPDATE=70,cinder:DELETE=6 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:00:20 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] e3a86412-322f-4dcc-a4ad-228a798d2eef was raw, no need to convert to raw {{(pid=93391) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 20 00:00:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:00:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:00:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:00:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:00:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:00:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:00:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:28 devstack sudo[113486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:00:28 devstack sudo[113486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:29 devstack sudo[113486]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.256s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:00:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:00:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 28 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:00:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:00:30 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=44,cinder:INSERT=10,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.026s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Uploaded volume to glance image-id: e3a86412-322f-4dcc-a4ad-228a798d2eef. {{(pid=93391) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.338s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2117453068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a632d85-8e9e-4539-a94e-09f5766036a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb213bd3ab02408db60d914decb3839a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:00:13Z,use_quota=True,user_id='3349abe13bae49d0b221becbfdd9c895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf8d28e1-66eb-4481-9c98-df310665b350),volume_type_id=cf8d28e1-66eb-4481-9c98-df310665b350)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Creating volume 1a632d85-8e9e-4539-a94e-09f5766036a9 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:00:48 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:00:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:48 devstack sudo[114124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 1073741824 Jun 20 00:00:48 devstack sudo[114124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:48 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0204d93a-7de8-464d-90ea-82b13343d484 tempest-VolumesActionsTest-1845533677 None] Copy volume to image completed successfully. Jun 20 00:00:49 devstack sudo[114124]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 1073741824" returned: 0 in 0.885s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:49 devstack sudo[114156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 Jun 20 00:00:49 devstack sudo[114156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:50 devstack sudo[114156]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9" returned: 0 in 0.668s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0d9a5f-1816-4b38-8a97-4e6e9ffca833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a632d85-8e9e-4539-a94e-09f5766036a9', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1194d50-79c2-4240-8fc6-b868e276fec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:50 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Volume volume-1a632d85-8e9e-4539-a94e-09f5766036a9 (1a632d85-8e9e-4539-a94e-09f5766036a9): created successfully Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1194d50-79c2-4240-8fc6-b868e276fec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Flow 'volume_create_manager' (0c505732-bda8-4b9c-aee2-a1ad0e967058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:00:50 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3c57be98-c2ca-4dfc-9462-31786e164d9f tempest-VolumeTypesAccessTest-923712374 None] Created volume successfully. Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb833bef-d23b-475d-a1f4-f0c35526e67e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:00:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:50 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 20 00:00:50 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Acquiring lock "cinder-1a632d85-8e9e-4539-a94e-09f5766036a9-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Lock "cinder-1a632d85-8e9e-4539-a94e-09f5766036a9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Acquiring lock "cinder-quobyte-1a632d85-8e9e-4539-a94e-09f5766036a9" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Lock "cinder-quobyte-1a632d85-8e9e-4539-a94e-09f5766036a9" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfcfff5-b855-44dd-bd09-877effc12ad0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:51 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 0.802s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df6d3f2-fbf4-4b8e-8451-7e95bd4e6fc4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:00:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:51 devstack sudo[114218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 Jun 20 00:00:51 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:51 devstack sudo[114222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 20 00:00:51 devstack sudo[114222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:52 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9" returned: 0 in 0.945s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:52 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9 Jun 20 00:00:52 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:52 devstack sudo[114222]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 0.983s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:52 devstack sudo[114261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img Jun 20 00:00:52 devstack sudo[114261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:53 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1a632d85-8e9e-4539-a94e-09f5766036a9" returned: 0 in 0.894s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Lock "cinder-quobyte-1a632d85-8e9e-4539-a94e-09f5766036a9" released by "delete_volume" :: held 1.904s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:00:53 devstack cinder-volume[93391]: WARNING cinder.quota [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-903314881 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-903314881, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:00:53 devstack cinder-volume[93391]: WARNING cinder.quota [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-903314881 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-903314881, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Created reservations ['fd13af9c-b45b-4b5f-b676-06417cb51645', '7f487d94-e002-4d66-937b-86036061bcd4', '2faec181-1cd0-4741-8bbc-e62629fb6110', '1204cd40-ff0d-4fdf-b7b3-c93b5844f9fa'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:00:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:53 devstack sudo[114309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:00:53 devstack sudo[114309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Flow 'volume_create_manager' (fe96dec1-ae5b-444d-a25b-7d9170510651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f635987-102b-4cf0-a79d-e70c63bcb387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f635987-102b-4cf0-a79d-e70c63bcb387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-248854767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3062b7bc-76dc-4537-a131-a8e08d5013db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50bf88eebe24f4ca7dd257958132da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:00:55Z,use_quota=True,user_id='81a08288f58a4dd98e7dcd6383000b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c3d035-82c3-4bd4-b850-4f2dd7b03da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c3d035-82c3-4bd4-b850-4f2dd7b03da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512a7036-b717-4e39-869d-ed1f2c514664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512a7036-b717-4e39-869d-ed1f2c514664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3062b7bc-76dc-4537-a131-a8e08d5013db', 'volume_name': 'volume-3062b7bc-76dc-4537-a131-a8e08d5013db', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6062f46-c5a3-4f31-91d2-fd3ea6ca6cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6062f46-c5a3-4f31-91d2-fd3ea6ca6cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2b2291-df45-4a67-8a29-436ef5b8e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:00:55 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Volume 3062b7bc-76dc-4537-a131-a8e08d5013db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3062b7bc-76dc-4537-a131-a8e08d5013db', 'volume_size': 1} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:00:55 devstack sudo[114309]: pam_unix(sudo:session): session closed for user root Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 2.173s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:00:55 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Deleted volume successfully. Jun 20 00:00:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccf2e472-994f-4d5b-9a1b-d85ef0789b96 tempest-VolumeTypesAccessTest-923712374 None] Lock "cinder-1a632d85-8e9e-4539-a94e-09f5766036a9-delete_volume" released by "delete_volume" :: held 4.507s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:00:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img" returned: 0 in 7.064s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:00:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[133484ca-636a-41c4-bbcb-3af6c020346b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:00:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:00:59 devstack sudo[114515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 20 00:00:59 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:00 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 1.008s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:00 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:01:00 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Converted 1024.00 MB image at 144.95 MB/s Jun 20 00:01:00 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] c9821e24-0190-4374-94d5-b90b2022f02f was raw, converting to qcow2 {{(pid=93391) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 20 00:01:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ab64af-8ba4-43f5-84de-1419900af294]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:00 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img Jun 20 00:01:00 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:01 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img" returned: 0 in 0.827s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:01 devstack sudo[114581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img Jun 20 00:01:01 devstack sudo[114581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:02 devstack sudo[114581]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img" returned: 1 in 0.792s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:01:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img /opt/stack/data/cinder/conversion/vol_upload_q41pqfu6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:02 devstack sudo[114614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img /opt/stack/data/cinder/conversion/vol_upload_q41pqfu6 Jun 20 00:01:02 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:02 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img /opt/stack/data/cinder/conversion/vol_upload_q41pqfu6" returned: 0 in 0.710s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:02 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Image conversion details: src /opt/stack/data/cinder/conversion/41a0f36f-0802-49bc-bdc6-5956d2e8eba9.temp_image.c9821e24-0190-4374-94d5-b90b2022f02ffrfxptjj.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_q41pqfu6 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:01:02 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 20 00:01:02 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de263221-3077-4f00-b98e-3899cb017216]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q41pqfu6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:02 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q41pqfu6 Jun 20 00:01:02 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:03 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q41pqfu6" returned: 0 in 0.787s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.431s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Uploaded volume to glance image-id: c9821e24-0190-4374-94d5-b90b2022f02f. {{(pid=93391) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 20 00:01:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.649s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-248854767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3062b7bc-76dc-4537-a131-a8e08d5013db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50bf88eebe24f4ca7dd257958132da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:00:55Z,use_quota=True,user_id='81a08288f58a4dd98e7dcd6383000b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Creating volume 3062b7bc-76dc-4537-a131-a8e08d5013db {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:06 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:06 devstack sudo[114823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db 1073741824 Jun 20 00:01:06 devstack sudo[114823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:06 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8f73eeba-a8d2-4a6b-86ad-8008b61f65b6 tempest-VolumesActionsTest-1845533677 None] Copy volume to image completed successfully. Jun 20 00:01:07 devstack sudo[114823]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db 1073741824" returned: 0 in 1.717s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:07 devstack sudo[114896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db Jun 20 00:01:07 devstack sudo[114896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Acquiring lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Acquiring lock "cinder-quobyte-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Lock "cinder-quobyte-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[042529ae-4e61-4625-ab34-243a3720c82e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (9a913435-bb15-4cbd-94ca-94ea5f704f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f628ea-101d-4e31-a80c-510f4c0104bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:08 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f628ea-101d-4e31-a80c-510f4c0104bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-946476903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f057e0-3265-4868-8199-43722b733ea4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:08Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:08 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053b60f8-bea5-4f3a-91c3-ee510411ea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (053b60f8-bea5-4f3a-91c3-ee510411ea21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb4fb5c-6b95-4471-b776-75ba778cd4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb4fb5c-6b95-4471-b776-75ba778cd4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f057e0-3265-4868-8199-43722b733ea4', 'volume_name': 'volume-a2f057e0-3265-4868-8199-43722b733ea4', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdca4b1-5cd7-44df-9d98-5ae5b8472a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdca4b1-5cd7-44df-9d98-5ae5b8472a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db7f2a8-b630-4324-a2b6-0833bfe1de8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:08 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Volume a2f057e0-3265-4868-8199-43722b733ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f057e0-3265-4868-8199-43722b733ea4', 'volume_size': 1} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:08 devstack sudo[114896]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db" returned: 0 in 0.989s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] <== create_volume: return (2791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.801s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.148s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-946476903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f057e0-3265-4868-8199-43722b733ea4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:08Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Creating volume a2f057e0-3265-4868-8199-43722b733ea4 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:08 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2b2291-df45-4a67-8a29-436ef5b8e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3062b7bc-76dc-4537-a131-a8e08d5013db', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a60e90b-f477-44fd-86f6-01e9636603c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:08 devstack sudo[114931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 1073741824 Jun 20 00:01:08 devstack sudo[114931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:08 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Volume volume-3062b7bc-76dc-4537-a131-a8e08d5013db (3062b7bc-76dc-4537-a131-a8e08d5013db): created successfully Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a60e90b-f477-44fd-86f6-01e9636603c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Flow 'volume_create_manager' (fe96dec1-ae5b-444d-a25b-7d9170510651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-390dde4f-aaf0-4113-932b-8a3c9626fb31 tempest-AttachVolumeTestJSON-148826376 None] Created volume successfully. Jun 20 00:01:09 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 1.291s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:09 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9 Jun 20 00:01:09 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (d09eaee0-3adc-45b3-898e-e9eabf44086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee827d8-3f91-4e87-b563-2c5a48cbf78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee827d8-3f91-4e87-b563-2c5a48cbf78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343557628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05206b96-9181-42d4-a744-6eb1b90c6ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:10Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203f0fb4-bcb5-48a4-84f9-3ea4cfe0ef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203f0fb4-bcb5-48a4-84f9-3ea4cfe0ef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8969a5e-5269-40fb-9451-fe35fb0880a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8969a5e-5269-40fb-9451-fe35fb0880a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05206b96-9181-42d4-a744-6eb1b90c6ae3', 'volume_name': 'volume-05206b96-9181-42d4-a744-6eb1b90c6ae3', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabf0b26-1f75-45fa-be80-f539f665131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabf0b26-1f75-45fa-be80-f539f665131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9d30f0-6294-4807-ab70-c1e1eb762bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:10 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Volume 05206b96-9181-42d4-a744-6eb1b90c6ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05206b96-9181-42d4-a744-6eb1b90c6ae3', 'volume_size': 1} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:10 devstack sudo[114931]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 1073741824" returned: 0 in 1.492s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:10 devstack sudo[114991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 Jun 20 00:01:10 devstack sudo[114991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:10 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" returned: 0 in 0.934s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Lock "cinder-quobyte-41a0f36f-0802-49bc-bdc6-5956d2e8eba9" released by "delete_volume" :: held 2.290s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Created reservations ['9cef8888-597f-46ff-8817-46f0c1191ef5', '3284a431-9331-4767-89cc-af36be16dda5', 'e3da4b95-25a8-4f13-b8f1-dce2cecf77a3', '8a2cb401-1291-4edc-8c1a-d3c07916997a'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:10 devstack sudo[115009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:10 devstack sudo[115009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:11 devstack sudo[114991]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4" returned: 0 in 0.734s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] <== create_volume: return (2302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343557628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05206b96-9181-42d4-a744-6eb1b90c6ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:10Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Creating volume 05206b96-9181-42d4-a744-6eb1b90c6ae3 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:11 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db7f2a8-b630-4324-a2b6-0833bfe1de8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f057e0-3265-4868-8199-43722b733ea4', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:11 devstack sudo[115021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 1073741824 Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52c6459-820e-45b9-889b-e4d64790555f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:11 devstack sudo[115021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:11 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Volume volume-a2f057e0-3265-4868-8199-43722b733ea4 (a2f057e0-3265-4868-8199-43722b733ea4): created successfully Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52c6459-820e-45b9-889b-e4d64790555f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (9a913435-bb15-4cbd-94ca-94ea5f704f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:11 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ecbda291-047a-46fb-a86a-86df465b5de3 tempest-VolumesGetTest-829185817 None] Created volume successfully. Jun 20 00:01:11 devstack sudo[115009]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.818s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:11 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Deleted volume successfully. Jun 20 00:01:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e3f0e7e9-7be1-46c7-b87a-f13f6efac0dc tempest-VolumesActionsTest-1845533677 None] Lock "cinder-41a0f36f-0802-49bc-bdc6-5956d2e8eba9-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:12 devstack sudo[115021]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 1073741824" returned: 0 in 1.493s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:12 devstack sudo[115108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 Jun 20 00:01:12 devstack sudo[115108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:12 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (06f51f93-7a0f-448a-9dca-5fc45be880a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4bce25-0174-42be-9dc8-0591c6c4b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4bce25-0174-42be-9dc8-0591c6c4b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1272083728',display_name='tempest-VolumesGetTest-Volume-1314124111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85793d93-35a6-4946-ab72-9704075b0f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:13Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bc57c5-79e5-4b1c-b29f-d69eb7917121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bc57c5-79e5-4b1c-b29f-d69eb7917121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad26cbd-053c-4661-af1a-1b3abf5df6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad26cbd-053c-4661-af1a-1b3abf5df6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85793d93-35a6-4946-ab72-9704075b0f42', 'volume_name': 'volume-85793d93-35a6-4946-ab72-9704075b0f42', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fe34c1-ba13-455e-9417-1bd9dfb8dc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fe34c1-ba13-455e-9417-1bd9dfb8dc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac37be5-2500-447d-9cbb-a92b1bc819fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:13 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Volume 85793d93-35a6-4946-ab72-9704075b0f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85793d93-35a6-4946-ab72-9704075b0f42', 'volume_size': 1} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7181a99b-0774-4c18-98d8-9b58b75fb3fe req-57bf9c15-52fa-4071-a269-1bdb18e525ff tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:13 devstack sudo[115108]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3" returned: 0 in 1.101s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] <== create_volume: return (2668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.672s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1272083728',display_name='tempest-VolumesGetTest-Volume-1314124111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85793d93-35a6-4946-ab72-9704075b0f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:13Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Creating volume 85793d93-35a6-4946-ab72-9704075b0f42 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:13 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:13 devstack sudo[115154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 1073741824 Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9d30f0-6294-4807-ab70-c1e1eb762bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05206b96-9181-42d4-a744-6eb1b90c6ae3', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:13 devstack sudo[115154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e56def-1a16-4f33-8f76-2870b95e014d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:13 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Volume volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 (05206b96-9181-42d4-a744-6eb1b90c6ae3): created successfully Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e56def-1a16-4f33-8f76-2870b95e014d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (d09eaee0-3adc-45b3-898e-e9eabf44086d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:13 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b5b44677-42b2-445d-9b48-b337237b8c30 tempest-VolumesActionsTest-465421856 None] Created volume successfully. Jun 20 00:01:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bb84e8f3-9734-4a31-a460-6ad13ecd528a tempest-VolumesActionsTest-465421856 None] Acquiring lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3" by "attach_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bb84e8f3-9734-4a31-a460-6ad13ecd528a tempest-VolumesActionsTest-465421856 None] Lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3" acquired by "attach_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bb84e8f3-9734-4a31-a460-6ad13ecd528a tempest-VolumesActionsTest-465421856 None] Attaching volume 05206b96-9181-42d4-a744-6eb1b90c6ae3 to instance 77570732-6943-495a-907c-784c48f85c45 at mountpoint /dev/vdb on host None. Jun 20 00:01:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bb84e8f3-9734-4a31-a460-6ad13ecd528a tempest-VolumesActionsTest-465421856 None] Attach volume completed successfully. Jun 20 00:01:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bb84e8f3-9734-4a31-a460-6ad13ecd528a tempest-VolumesActionsTest-465421856 None] Lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3" released by "attach_volume" :: held 0.141s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:14 devstack sudo[115154]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 1073741824" returned: 0 in 1.080s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:14 devstack sudo[115195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 Jun 20 00:01:14 devstack sudo[115195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:15 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-37de26e7-9d82-47f1-8300-26da928be141 tempest-VolumesActionsTest-1381811945 None] Terminate volume connection completed successfully. Jun 20 00:01:15 devstack sudo[115195]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42" returned: 0 in 1.035s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:15 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7181a99b-0774-4c18-98d8-9b58b75fb3fe req-57bf9c15-52fa-4071-a269-1bdb18e525ff tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.390s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac37be5-2500-447d-9cbb-a92b1bc819fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85793d93-35a6-4946-ab72-9704075b0f42', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094981da-f966-44fc-8f3c-70477cbaccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f41dcb0-d9a5-46f7-a6b5-ef1dd63ce4d7]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-7181a99b-0774-4c18-98d8-9b58b75fb3fe req-57bf9c15-52fa-4071-a269-1bdb18e525ff tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:16 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Volume volume-85793d93-35a6-4946-ab72-9704075b0f42 (85793d93-35a6-4946-ab72-9704075b0f42): created successfully Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094981da-f966-44fc-8f3c-70477cbaccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (06f51f93-7a0f-448a-9dca-5fc45be880a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:16 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0dd0ea5e-2707-44c9-9502-6c9da3862cca tempest-VolumesGetTest-829185817 None] Created volume successfully. Jun 20 00:01:16 devstack sudo[115231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db Jun 20 00:01:16 devstack sudo[115231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-37de26e7-9d82-47f1-8300-26da928be141 tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-detach_volume" by "detach_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-37de26e7-9d82-47f1-8300-26da928be141 tempest-VolumesActionsTest-1381811945 None] Lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:16 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-37de26e7-9d82-47f1-8300-26da928be141 tempest-VolumesActionsTest-1381811945 None] Detaching volume 05206b96-9181-42d4-a744-6eb1b90c6ae3 from instance 77570732-6943-495a-907c-784c48f85c45. Jun 20 00:01:16 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-37de26e7-9d82-47f1-8300-26da928be141 tempest-VolumesActionsTest-1381811945 None] Detach volume completed successfully. Jun 20 00:01:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-37de26e7-9d82-47f1-8300-26da928be141 tempest-VolumesActionsTest-1381811945 None] Lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:17 devstack sudo[115231]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-7181a99b-0774-4c18-98d8-9b58b75fb3fe req-57bf9c15-52fa-4071-a269-1bdb18e525ff tempest-AttachVolumeTestJSON-148826376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db" returned: 0 in 1.166s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7181a99b-0774-4c18-98d8-9b58b75fb3fe req-57bf9c15-52fa-4071-a269-1bdb18e525ff tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.218s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-7181a99b-0774-4c18-98d8-9b58b75fb3fe req-57bf9c15-52fa-4071-a269-1bdb18e525ff tempest-AttachVolumeTestJSON-148826376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-3062b7bc-76dc-4537-a131-a8e08d5013db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee101aaf-f77a-445b-89c8-9ad9805379bd', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b659940d-42b6-4d2d-94d5-5c495b0c4ae8 tempest-VolumesActionsTest-465421856 None] Acquiring lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-detach_volume" by "detach_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b659940d-42b6-4d2d-94d5-5c495b0c4ae8 tempest-VolumesActionsTest-465421856 None] Lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b659940d-42b6-4d2d-94d5-5c495b0c4ae8 tempest-VolumesActionsTest-465421856 None] Volume detach called, but volume not attached. Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b659940d-42b6-4d2d-94d5-5c495b0c4ae8 tempest-VolumesActionsTest-465421856 None] Lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-7181a99b-0774-4c18-98d8-9b58b75fb3fe req-57bf9c15-52fa-4071-a269-1bdb18e525ff tempest-AttachVolumeTestJSON-148826376 None] attachment_update completed successfully. Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-85793d93-35a6-4946-ab72-9704075b0f42-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Lock "cinder-85793d93-35a6-4946-ab72-9704075b0f42-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-85793d93-35a6-4946-ab72-9704075b0f42" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-85793d93-35a6-4946-ab72-9704075b0f42" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6671496c-29b2-47aa-8c3b-315a249bba34]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:18 devstack sudo[115361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 Jun 20 00:01:18 devstack sudo[115361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Acquiring lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Acquiring lock "cinder-quobyte-05206b96-9181-42d4-a744-6eb1b90c6ae3" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Lock "cinder-quobyte-05206b96-9181-42d4-a744-6eb1b90c6ae3" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:18 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb40506-19a7-489d-a7b7-4761a318817a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:18 devstack sudo[115378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 Jun 20 00:01:18 devstack sudo[115378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:19 devstack sudo[115361]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42" returned: 0 in 1.337s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:19 devstack sudo[115749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42 Jun 20 00:01:19 devstack sudo[115749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:19 devstack sudo[115378]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3" returned: 0 in 1.188s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:19 devstack sudo[115764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3 Jun 20 00:01:19 devstack sudo[115764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:20 devstack sudo[115749]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-85793d93-35a6-4946-ab72-9704075b0f42" returned: 0 in 0.754s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-85793d93-35a6-4946-ab72-9704075b0f42" released by "delete_volume" :: held 2.164s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Created reservations ['7b4f6a78-feae-4715-a3b0-e682819001b3', '516e82f7-4caa-4614-ab87-708ce57e6057', 'c24538cf-90b7-4e56-93c8-f0d20a1c27a8', '060ba8a6-a875-44fd-911f-77f2b0b8dbde'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:20 devstack sudo[115785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:20 devstack sudo[115785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:20 devstack sudo[115764]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-05206b96-9181-42d4-a744-6eb1b90c6ae3" returned: 0 in 0.762s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Lock "cinder-quobyte-05206b96-9181-42d4-a744-6eb1b90c6ae3" released by "delete_volume" :: held 2.016s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Created reservations ['ef1e2bfe-56ed-4d96-b58a-4aef01a5e790', '33ed4aae-54fd-4070-ac0c-2afd48150fe8', '582fe16b-994f-49b0-8287-58c0877dbe0b', 'e5556987-24fa-4710-99b9-7da97c14bfd3'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:20 devstack sudo[115797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:20 devstack sudo[115797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Flow 'volume_create_manager' (b7d8515e-f9a2-472e-9010-7ed89c856b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87458360-6a23-45d2-b5d1-5bdaa873de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87458360-6a23-45d2-b5d1-5bdaa873de22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-713682117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bebb41-8b56-46fc-a63d-8449a78c439f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c4b7c70c157457c8a9114fe7f25f280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:21Z,use_quota=True,user_id='1df8d324827e47e3b8d34d6b6fa9b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849b76f3-dbea-409a-84a4-edab65566782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849b76f3-dbea-409a-84a4-edab65566782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3b8b54-df5c-4a33-a12d-2fd7ed1dbcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3b8b54-df5c-4a33-a12d-2fd7ed1dbcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1bebb41-8b56-46fc-a63d-8449a78c439f', 'volume_name': 'volume-d1bebb41-8b56-46fc-a63d-8449a78c439f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8662bebc-e5c9-4d27-9b33-c70373844d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8662bebc-e5c9-4d27-9b33-c70373844d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7524b8be-40ea-475d-8404-51d157a61778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:20 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Volume d1bebb41-8b56-46fc-a63d-8449a78c439f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1bebb41-8b56-46fc-a63d-8449a78c439f', 'volume_size': 1} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-713682117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bebb41-8b56-46fc-a63d-8449a78c439f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c4b7c70c157457c8a9114fe7f25f280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:21Z,use_quota=True,user_id='1df8d324827e47e3b8d34d6b6fa9b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Creating volume d1bebb41-8b56-46fc-a63d-8449a78c439f {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:20 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:20 devstack sudo[115810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f 1073741824 Jun 20 00:01:20 devstack sudo[115810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:20 devstack sudo[115785]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.757s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:20 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Deleted volume successfully. Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4d5c4ced-aff7-4784-b4f3-d6a6894e21fd tempest-VolumesGetTest-829185817 None] Lock "cinder-85793d93-35a6-4946-ab72-9704075b0f42-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-a2f057e0-3265-4868-8199-43722b733ea4-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Lock "cinder-a2f057e0-3265-4868-8199-43722b733ea4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-a2f057e0-3265-4868-8199-43722b733ea4" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-a2f057e0-3265-4868-8199-43722b733ea4" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5337ee65-2dc1-4c16-9433-4f6137be28b4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:21 devstack sudo[115797]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.746s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Deleted volume successfully. Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fe93250e-c8da-4bac-a523-9ea7785afa8f tempest-VolumesActionsTest-465421856 None] Lock "cinder-05206b96-9181-42d4-a744-6eb1b90c6ae3-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:21 devstack sudo[115826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 Jun 20 00:01:21 devstack sudo[115826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:21 devstack sudo[115810]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f 1073741824" returned: 0 in 0.976s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:21 devstack sudo[115851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f Jun 20 00:01:21 devstack sudo[115851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:22 devstack sudo[115826]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4" returned: 0 in 0.945s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:22 devstack sudo[115866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4 Jun 20 00:01:22 devstack sudo[115866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:22 devstack sudo[115851]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f" returned: 0 in 0.719s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7524b8be-40ea-475d-8404-51d157a61778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1bebb41-8b56-46fc-a63d-8449a78c439f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b240f81-5493-48ab-afe1-d13099eba67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:22 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Volume volume-d1bebb41-8b56-46fc-a63d-8449a78c439f (d1bebb41-8b56-46fc-a63d-8449a78c439f): created successfully Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b240f81-5493-48ab-afe1-d13099eba67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Flow 'volume_create_manager' (b7d8515e-f9a2-472e-9010-7ed89c856b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:22 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-4c037f90-2f9e-42c6-b951-905af3cce3ed tempest-VolumesListTestJSON-699921856 None] Created volume successfully. Jun 20 00:01:23 devstack sudo[115866]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a2f057e0-3265-4868-8199-43722b733ea4" returned: 0 in 0.912s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-a2f057e0-3265-4868-8199-43722b733ea4" released by "delete_volume" :: held 1.921s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Created reservations ['95ad6de7-2ee0-46d6-bae9-acebd952ed8b', 'd9ee06c4-7943-4915-8594-ec1dfca2347e', 'a4ad84ba-9c71-470e-a98a-d0612a48a4f3', 'f62f5007-82e7-40c8-bc29-118e42858042'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:23 devstack sudo[115947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:23 devstack sudo[115947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Flow 'volume_create_manager' (131b5d12-3f0f-4c1b-82da-2db0c4fff990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9da4428-b209-4fdd-926c-40c14fd6a842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9da4428-b209-4fdd-926c-40c14fd6a842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-519707307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3b374e-c49a-43c2-aa61-6205b3931b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50bf88eebe24f4ca7dd257958132da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:24Z,use_quota=True,user_id='81a08288f58a4dd98e7dcd6383000b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057e7968-b0ca-4110-b855-101886938ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057e7968-b0ca-4110-b855-101886938ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518580da-6d40-4d02-8aee-9a8c6a86b85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518580da-6d40-4d02-8aee-9a8c6a86b85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3b374e-c49a-43c2-aa61-6205b3931b47', 'volume_name': 'volume-6f3b374e-c49a-43c2-aa61-6205b3931b47', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca6df10-f380-4a1f-baad-0ea017ee50e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca6df10-f380-4a1f-baad-0ea017ee50e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adaebd18-5033-4534-aab5-307fdb2f93c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Volume 6f3b374e-c49a-43c2-aa61-6205b3931b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3b374e-c49a-43c2-aa61-6205b3931b47', 'volume_size': 1} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-519707307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3b374e-c49a-43c2-aa61-6205b3931b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50bf88eebe24f4ca7dd257958132da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:24Z,use_quota=True,user_id='81a08288f58a4dd98e7dcd6383000b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Creating volume 6f3b374e-c49a-43c2-aa61-6205b3931b47 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:24 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:24 devstack sudo[115965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 1073741824 Jun 20 00:01:24 devstack sudo[115965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Flow 'volume_create_manager' (e82d2dc5-3367-4e0a-ab91-1be72e0e7d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33725792-4749-4b88-9354-97e8991277f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33725792-4749-4b88-9354-97e8991277f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1212536954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4436aebc-2e38-458c-bfad-36cc9bc87c89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c4b7c70c157457c8a9114fe7f25f280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:24Z,use_quota=True,user_id='1df8d324827e47e3b8d34d6b6fa9b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53ca3d9-4214-4ef2-9ae8-7845263f9323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53ca3d9-4214-4ef2-9ae8-7845263f9323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cd4407-0330-4221-9549-240f9f573020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cd4407-0330-4221-9549-240f9f573020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4436aebc-2e38-458c-bfad-36cc9bc87c89', 'volume_name': 'volume-4436aebc-2e38-458c-bfad-36cc9bc87c89', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba391c7e-f4ad-402a-8e0a-9ab64ef6dd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba391c7e-f4ad-402a-8e0a-9ab64ef6dd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff52b206-ba58-41c7-8c0e-6626e8b837d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Volume 4436aebc-2e38-458c-bfad-36cc9bc87c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4436aebc-2e38-458c-bfad-36cc9bc87c89', 'volume_size': 1} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (6cba0756-8e7e-4ce5-9362-4a55f24ed983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e188fea9-765f-436a-9be0-945ad24426cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e188fea9-765f-436a-9be0-945ad24426cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-941592814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16530b00-5394-4fa3-9de3-9dd00af4f644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:24Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7002819-86e2-488e-be4b-84a847ef4198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7002819-86e2-488e-be4b-84a847ef4198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d146c82-adde-46d0-ad2c-1ecf5a32d5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d146c82-adde-46d0-ad2c-1ecf5a32d5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16530b00-5394-4fa3-9de3-9dd00af4f644', 'volume_name': 'volume-16530b00-5394-4fa3-9de3-9dd00af4f644', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44fcf3a-dd7d-474b-b38c-d74eeefe942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44fcf3a-dd7d-474b-b38c-d74eeefe942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0fcd5c-680b-4517-a471-f17e15a2c674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:24 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Volume 16530b00-5394-4fa3-9de3-9dd00af4f644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16530b00-5394-4fa3-9de3-9dd00af4f644', 'volume_size': 1} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:24 devstack sudo[115947]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.017s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:24 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Deleted volume successfully. Jun 20 00:01:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ae20eee3-3b96-4d45-9afc-51408578f6a4 tempest-VolumesGetTest-829185817 None] Lock "cinder-a2f057e0-3265-4868-8199-43722b733ea4-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:25 devstack sudo[115965]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 1073741824" returned: 0 in 1.030s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:25 devstack sudo[116008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 Jun 20 00:01:25 devstack sudo[116008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:25 devstack sudo[116008]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47" returned: 0 in 0.656s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1212536954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4436aebc-2e38-458c-bfad-36cc9bc87c89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c4b7c70c157457c8a9114fe7f25f280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:24Z,use_quota=True,user_id='1df8d324827e47e3b8d34d6b6fa9b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Creating volume 4436aebc-2e38-458c-bfad-36cc9bc87c89 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:25 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:25 devstack sudo[116029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 1073741824 Jun 20 00:01:25 devstack sudo[116029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adaebd18-5033-4534-aab5-307fdb2f93c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3b374e-c49a-43c2-aa61-6205b3931b47', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53680e15-8c1a-4fd7-876d-43c32e90c5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:25 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Volume volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 (6f3b374e-c49a-43c2-aa61-6205b3931b47): created successfully Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53680e15-8c1a-4fd7-876d-43c32e90c5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Flow 'volume_create_manager' (131b5d12-3f0f-4c1b-82da-2db0c4fff990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:25 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-4755a555-3994-4f51-85f8-a24618cc6c33 tempest-AttachVolumeTestJSON-148826376 None] Created volume successfully. Jun 20 00:01:26 devstack sudo[116029]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 1073741824" returned: 0 in 0.827s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:26 devstack sudo[116063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 Jun 20 00:01:26 devstack sudo[116063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:27 devstack sudo[116063]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89" returned: 0 in 0.688s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.900s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-941592814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16530b00-5394-4fa3-9de3-9dd00af4f644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:24Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Creating volume 16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:27 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff52b206-ba58-41c7-8c0e-6626e8b837d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4436aebc-2e38-458c-bfad-36cc9bc87c89', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:27 devstack sudo[116090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 1073741824 Jun 20 00:01:27 devstack sudo[116090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7cbeae-4df4-44c8-a1c6-9a7dffe8b710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:27 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Volume volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 (4436aebc-2e38-458c-bfad-36cc9bc87c89): created successfully Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7cbeae-4df4-44c8-a1c6-9a7dffe8b710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Flow 'volume_create_manager' (e82d2dc5-3367-4e0a-ab91-1be72e0e7d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-aa383132-afbe-4d9f-8c44-aa633de4a7e3 tempest-VolumesListTestJSON-699921856 None] Created volume successfully. Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:28 devstack sudo[116112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:28 devstack sudo[116112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:28 devstack sudo[116090]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 1073741824" returned: 0 in 0.953s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:28 devstack sudo[116128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 Jun 20 00:01:28 devstack sudo[116128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:28 devstack sudo[116112]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Flow 'volume_create_manager' (9de2696d-bd6c-4dab-b51f-c3f157e0e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3108e5e-ad21-4b7a-a0c7-0a43e5592586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.943s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3108e5e-ad21-4b7a-a0c7-0a43e5592586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1950449407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cb3485-f9c4-4dd8-9aff-e39cbc745326,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c4b7c70c157457c8a9114fe7f25f280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:29Z,use_quota=True,user_id='1df8d324827e47e3b8d34d6b6fa9b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb56491-fadd-4070-b3a0-de8836d86c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb56491-fadd-4070-b3a0-de8836d86c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709574f4-1ad8-426e-9168-cec804fd9ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709574f4-1ad8-426e-9168-cec804fd9ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20cb3485-f9c4-4dd8-9aff-e39cbc745326', 'volume_name': 'volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d109aa5-0712-4c8b-96e4-337ca3989922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d109aa5-0712-4c8b-96e4-337ca3989922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c93feb0-d716-4fc7-acba-cefa76059a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Volume 20cb3485-f9c4-4dd8-9aff-e39cbc745326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326', 'volume_size': 1} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (9054d286-cdec-4e13-9337-6f8b1afd1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d788874-de63-4f69-9cf8-764f2d080096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d788874-de63-4f69-9cf8-764f2d080096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-333265635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572b7a39-aa8c-4cd9-9dac-6657f16f71b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:29Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1341197-d4e5-4553-9758-4617f761c554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1341197-d4e5-4553-9758-4617f761c554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eb8a0f-4ed2-4df9-8164-228303bca004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eb8a0f-4ed2-4df9-8164-228303bca004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572b7a39-aa8c-4cd9-9dac-6657f16f71b3', 'volume_name': 'volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af84eb11-6166-44a4-8f28-759d9f9b0bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af84eb11-6166-44a4-8f28-759d9f9b0bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb62333-ce8f-43c8-be53-311e030db463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Volume 572b7a39-aa8c-4cd9-9dac-6657f16f71b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3', 'volume_size': 1} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:29 devstack sudo[116128]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644" returned: 0 in 0.884s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1950449407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20cb3485-f9c4-4dd8-9aff-e39cbc745326,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4c4b7c70c157457c8a9114fe7f25f280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:29Z,use_quota=True,user_id='1df8d324827e47e3b8d34d6b6fa9b09f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Creating volume 20cb3485-f9c4-4dd8-9aff-e39cbc745326 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:29 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:29 devstack sudo[116159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 1073741824 Jun 20 00:01:29 devstack sudo[116159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0fcd5c-680b-4517-a471-f17e15a2c674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16530b00-5394-4fa3-9de3-9dd00af4f644', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a9f8af-9133-4ec0-a696-e11d0b0239ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:29 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Volume volume-16530b00-5394-4fa3-9de3-9dd00af4f644 (16530b00-5394-4fa3-9de3-9dd00af4f644): created successfully Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a9f8af-9133-4ec0-a696-e11d0b0239ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (6cba0756-8e7e-4ce5-9362-4a55f24ed983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:29 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d1c16a8b-7b60-4e3c-be3a-7a2ed6a4b619 tempest-VolumesGetTest-829185817 None] Created volume successfully. Jun 20 00:01:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-6511d748-5789-4704-b79f-0614c6836761 req-70f232cf-fbc5-4571-93d2-42cbde1d73b7 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:30 devstack sudo[116159]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 1073741824" returned: 0 in 0.886s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:30 devstack sudo[116200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 Jun 20 00:01:30 devstack sudo[116200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (91f5f202-c766-4531-9bed-0ccef2f0c1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d230f2bc-59e3-4643-b1e5-11f768a1c3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d230f2bc-59e3-4643-b1e5-11f768a1c3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-274698725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=16530b00-5394-4fa3-9de3-9dd00af4f644,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:30Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd56303b-a5e8-4f9c-b12c-f13274904e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd56303b-a5e8-4f9c-b12c-f13274904e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef2d440-9974-4451-af21-af1ddbe0bc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef2d440-9974-4451-af21-af1ddbe0bc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d', 'volume_name': 'volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d', 'volume_size': 1, 'source_volid': '16530b00-5394-4fa3-9de3-9dd00af4f644', 'source_volstatus': 'available'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93acc414-d2d3-4ad7-a246-accd333a07c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93acc414-d2d3-4ad7-a246-accd333a07c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae9dbbd-09ac-4ba7-adde-8269c4de68b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:30 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Volume c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d', 'volume_size': 1, 'source_volid': '16530b00-5394-4fa3-9de3-9dd00af4f644', 'source_volstatus': 'available'} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:30 devstack sudo[116200]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326" returned: 0 in 0.653s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-333265635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572b7a39-aa8c-4cd9-9dac-6657f16f71b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:29Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Creating volume 572b7a39-aa8c-4cd9-9dac-6657f16f71b3 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:30 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c93feb0-d716-4fc7-acba-cefa76059a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:30 devstack sudo[116224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 1073741824 Jun 20 00:01:30 devstack sudo[116224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9e8e0e-cc60-43c9-9f57-cc96360ff670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:30 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Volume volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 (20cb3485-f9c4-4dd8-9aff-e39cbc745326): created successfully Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9e8e0e-cc60-43c9-9f57-cc96360ff670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Flow 'volume_create_manager' (9de2696d-bd6c-4dab-b51f-c3f157e0e71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:30 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c40f207a-6107-470d-bded-f53f60efa59b tempest-VolumesListTestJSON-699921856 None] Created volume successfully. Jun 20 00:01:31 devstack sudo[116224]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 1073741824" returned: 0 in 0.829s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:31 devstack sudo[116254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 Jun 20 00:01:31 devstack sudo[116254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:32 devstack sudo[116254]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3" returned: 0 in 0.650s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-6511d748-5789-4704-b79f-0614c6836761 req-70f232cf-fbc5-4571-93d2-42cbde1d73b7 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.478s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb62333-ce8f-43c8-be53-311e030db463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd99715-b95f-41f3-8b49-d9aa91d876c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7527d9-1989-442a-a6bc-9e27c7ee2cd0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-6511d748-5789-4704-b79f-0614c6836761 req-70f232cf-fbc5-4571-93d2-42cbde1d73b7 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:32 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Volume volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 (572b7a39-aa8c-4cd9-9dac-6657f16f71b3): created successfully Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd99715-b95f-41f3-8b49-d9aa91d876c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (9054d286-cdec-4e13-9337-6f8b1afd1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b3697021-bba7-4917-87b4-6a10ded1f137 tempest-VolumesActionsTest-465421856 None] Created volume successfully. Jun 20 00:01:32 devstack sudo[116278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 Jun 20 00:01:32 devstack sudo[116278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:33 devstack sudo[116278]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-6511d748-5789-4704-b79f-0614c6836761 req-70f232cf-fbc5-4571-93d2-42cbde1d73b7 tempest-AttachVolumeTestJSON-148826376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47" returned: 0 in 0.770s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-6511d748-5789-4704-b79f-0614c6836761 req-70f232cf-fbc5-4571-93d2-42cbde1d73b7 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.795s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.751s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:33 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Cloning volume 16530b00-5394-4fa3-9de3-9dd00af4f644 to volume c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Creating offline snapshot 987b9623-df84-4756-afae-e3ea1bdbdbbb of volume 16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-6511d748-5789-4704-b79f-0614c6836761 req-70f232cf-fbc5-4571-93d2-42cbde1d73b7 tempest-AttachVolumeTestJSON-148826376 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-6f3b374e-c49a-43c2-aa61-6205b3931b47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07ce6fe9-374d-4120-962a-5ad28c7650c2', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b80c3d4-8f1e-4d62-833d-883125879f96]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:33 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-6511d748-5789-4704-b79f-0614c6836761 req-70f232cf-fbc5-4571-93d2-42cbde1d73b7 tempest-AttachVolumeTestJSON-148826376 None] attachment_update completed successfully. Jun 20 00:01:33 devstack sudo[116307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 Jun 20 00:01:33 devstack sudo[116307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-572b7a39-aa8c-4cd9-9dac-6657f16f71b3-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Lock "cinder-572b7a39-aa8c-4cd9-9dac-6657f16f71b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-quobyte-572b7a39-aa8c-4cd9-9dac-6657f16f71b3" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Lock "cinder-quobyte-572b7a39-aa8c-4cd9-9dac-6657f16f71b3" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba0fc12-69d8-42a0-bd7b-cc36f14dd1eb]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Acquiring lock "cinder-20cb3485-f9c4-4dd8-9aff-e39cbc745326-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:34 devstack sudo[116330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 Jun 20 00:01:34 devstack sudo[116330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Lock "cinder-20cb3485-f9c4-4dd8-9aff-e39cbc745326-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Acquiring lock "cinder-quobyte-20cb3485-f9c4-4dd8-9aff-e39cbc745326" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Lock "cinder-quobyte-20cb3485-f9c4-4dd8-9aff-e39cbc745326" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a902a7ad-c71d-4cfd-87be-4069b8423573]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:34 devstack sudo[116307]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644" returned: 0 in 0.987s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:34 devstack sudo[116351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb 1G Jun 20 00:01:34 devstack sudo[116351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:34 devstack sudo[116349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 Jun 20 00:01:34 devstack sudo[116349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:34 devstack sudo[116330]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3" returned: 0 in 0.934s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:34 devstack sudo[116378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3 Jun 20 00:01:34 devstack sudo[116378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:35 devstack sudo[116349]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326" returned: 0 in 0.881s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:35 devstack sudo[116390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326 Jun 20 00:01:35 devstack sudo[116390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:35 devstack sudo[116351]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb 1G" returned: 0 in 0.916s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16530b00-5394-4fa3-9de3-9dd00af4f644 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:35 devstack sudo[116395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16530b00-5394-4fa3-9de3-9dd00af4f644 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb Jun 20 00:01:35 devstack sudo[116395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:35 devstack sudo[116378]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-572b7a39-aa8c-4cd9-9dac-6657f16f71b3" returned: 0 in 0.701s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Lock "cinder-quobyte-572b7a39-aa8c-4cd9-9dac-6657f16f71b3" released by "delete_volume" :: held 1.697s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Created reservations ['deb769ad-8eba-40f7-a65d-5759dbb71c9f', '6006dffa-740a-475a-bd1b-342346ec7f4f', '3cbb0116-017e-4637-842e-df48cb501479', '85efd793-59d9-4adb-82a0-5d82c3519064'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:35 devstack sudo[116419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:35 devstack sudo[116390]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:35 devstack sudo[116419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20cb3485-f9c4-4dd8-9aff-e39cbc745326" returned: 0 in 0.673s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Lock "cinder-quobyte-20cb3485-f9c4-4dd8-9aff-e39cbc745326" released by "delete_volume" :: held 1.607s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Created reservations ['3c2d036a-2564-4871-9e37-d498a52eeb21', 'ac103825-3c58-46fc-b46f-e0a542ba58a5', '64331283-0c59-4a2a-9a91-84d1b45f4610', '7a657b6d-47f8-4e79-a4e8-d32a8e2a3866'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:36 devstack sudo[116395]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16530b00-5394-4fa3-9de3-9dd00af4f644 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb" returned: 0 in 0.801s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:36 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb is being set with open permissions: ugo+rw Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:36 devstack sudo[116429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb Jun 20 00:01:36 devstack sudo[116429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:36 devstack sudo[116428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:36 devstack sudo[116428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Acquiring lock "cinder-4436aebc-2e38-458c-bfad-36cc9bc87c89-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Lock "cinder-4436aebc-2e38-458c-bfad-36cc9bc87c89-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Acquiring lock "cinder-quobyte-4436aebc-2e38-458c-bfad-36cc9bc87c89" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Lock "cinder-quobyte-4436aebc-2e38-458c-bfad-36cc9bc87c89" acquired by "delete_volume" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7815027a-94f8-4892-bff5-0717ab1999cb]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:36 devstack sudo[116419]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.967s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:36 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Deleted volume successfully. Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65c63a30-22a4-4891-ae5b-3d240d736b7f tempest-VolumesActionsTest-1381811945 None] Lock "cinder-572b7a39-aa8c-4cd9-9dac-6657f16f71b3-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:36 devstack sudo[116454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 Jun 20 00:01:36 devstack sudo[116454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (370db327-e19d-4729-80c3-ff688149cf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529736b1-8dc0-41f0-9af2-d5fe00d94acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (529736b1-8dc0-41f0-9af2-d5fe00d94acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231283493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc61d4f7-ebe3-4363-b925-8850457131ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:37Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87512a96-d152-4010-81e9-a986062221e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87512a96-d152-4010-81e9-a986062221e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738da35c-9f69-4cba-b0b7-6435b6e1c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738da35c-9f69-4cba-b0b7-6435b6e1c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc61d4f7-ebe3-4363-b925-8850457131ad', 'volume_name': 'volume-cc61d4f7-ebe3-4363-b925-8850457131ad', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309f00dd-1b35-47ac-9ab3-bd77f1813878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309f00dd-1b35-47ac-9ab3-bd77f1813878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a154b09f-f892-46c9-b00e-278fe2d8c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Volume cc61d4f7-ebe3-4363-b925-8850457131ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc61d4f7-ebe3-4363-b925-8850457131ad', 'volume_size': 1} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:37 devstack sudo[116428]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.059s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:37 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Deleted volume successfully. Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bba4500f-3fee-4f15-a566-9337498107c6 tempest-VolumesListTestJSON-699921856 None] Lock "cinder-20cb3485-f9c4-4dd8-9aff-e39cbc745326-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:37 devstack sudo[116429]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb" returned: 0 in 1.093s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:37 devstack sudo[116470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.info Jun 20 00:01:37 devstack sudo[116470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:37 devstack sudo[116454]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89" returned: 0 in 0.964s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:37 devstack sudo[116490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89 Jun 20 00:01:37 devstack sudo[116490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:37 devstack sudo[116470]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.info" returned: 0 in 0.722s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:37 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.info is being set with open permissions: ugo+rw Jun 20 00:01:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:37 devstack sudo[116523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.info Jun 20 00:01:37 devstack sudo[116523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:38 devstack sudo[116490]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4436aebc-2e38-458c-bfad-36cc9bc87c89" returned: 0 in 0.660s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Lock "cinder-quobyte-4436aebc-2e38-458c-bfad-36cc9bc87c89" released by "delete_volume" :: held 1.679s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Created reservations ['2b5b599a-9e12-43bf-9101-e3a3dcf7570c', '382dbe37-0ea7-4e92-b028-abbb14825a7a', '365db6f8-7e9d-4c04-92cb-08401d6a8cce', 'dcdfa4fa-1646-4fba-99e5-034ce6364fb5'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:38 devstack sudo[116547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:38 devstack sudo[116547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:38 devstack sudo[116523]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.info" returned: 0 in 0.688s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] snapshot: 987b9623-df84-4756-afae-e3ea1bdbdbbb, volume: c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a9bc9d-2165-40f9-b820-fa58e82807d8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:38 devstack sudo[116555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb Jun 20 00:01:38 devstack sudo[116555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Acquiring lock "cinder-d1bebb41-8b56-46fc-a63d-8449a78c439f-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Lock "cinder-d1bebb41-8b56-46fc-a63d-8449a78c439f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Acquiring lock "cinder-quobyte-d1bebb41-8b56-46fc-a63d-8449a78c439f" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Lock "cinder-quobyte-d1bebb41-8b56-46fc-a63d-8449a78c439f" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[181f98dc-1a29-4aef-ae99-cd5f9751e41c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:39 devstack sudo[116567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f Jun 20 00:01:39 devstack sudo[116567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:39 devstack sudo[116547]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.781s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Deleted volume successfully. Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0136c367-8291-4176-bbe8-8dd5a38cbb45 tempest-VolumesListTestJSON-699921856 None] Lock "cinder-4436aebc-2e38-458c-bfad-36cc9bc87c89-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:39 devstack sudo[116555]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb" returned: 0 in 1.005s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16530b00-5394-4fa3-9de3-9dd00af4f644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56a05c-96fc-4d1c-bd17-3a78eb960ce9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:39 devstack sudo[116593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 Jun 20 00:01:39 devstack sudo[116593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:39 devstack sudo[116567]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f" returned: 0 in 0.877s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:39 devstack sudo[116604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f Jun 20 00:01:39 devstack sudo[116604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:40 devstack sudo[116593]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644" returned: 0 in 0.815s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:40 devstack sudo[116633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d Jun 20 00:01:40 devstack sudo[116633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=90,cinder:UPDATE=112,cinder:DELETE=6,cinder:INSERT=27 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=101,cinder:SELECT=89,cinder:INSERT=20,cinder:DELETE=13 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:01:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-bf6b2ff2-396b-4520-92e2-e85c7a131c7d req-4881fa93-1eab-4a70-a5b6-d2b7b1455084 tempest-AttachVolumeTestJSON-148826376 None] Terminate volume connection completed successfully. Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bf6b2ff2-396b-4520-92e2-e85c7a131c7d req-4881fa93-1eab-4a70-a5b6-d2b7b1455084 tempest-AttachVolumeTestJSON-148826376 None] Deleting attachment ee101aaf-f77a-445b-89c8-9ad9805379bd. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:01:40 devstack sudo[116604]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d1bebb41-8b56-46fc-a63d-8449a78c439f" returned: 0 in 0.738s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Lock "cinder-quobyte-d1bebb41-8b56-46fc-a63d-8449a78c439f" released by "delete_volume" :: held 1.668s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Created reservations ['37e0ad79-9bf5-4d1a-96ce-1715596bc233', 'bb7d4b98-525c-4488-a8c8-adb56adee136', '77eb62e4-6ef9-4628-bc29-9bd97c69027f', 'f53ac8ea-1857-4181-978e-a5993e58821d'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:40 devstack sudo[116644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:40 devstack sudo[116644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:41 devstack sudo[116644]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.759s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:41 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:41 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Deleted volume successfully. Jun 20 00:01:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccc2affd-1802-4075-b865-f6d3916ab8ef tempest-VolumesListTestJSON-699921856 None] Lock "cinder-d1bebb41-8b56-46fc-a63d-8449a78c439f-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-a70def2c-a153-4fcd-b0c4-52bb67fa7e58 req-1ad9f1e9-e1f5-495f-9005-2c58a8d6db79 tempest-AttachVolumeTestJSON-148826376 None] Terminate volume connection completed successfully. Jun 20 00:01:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-a70def2c-a153-4fcd-b0c4-52bb67fa7e58 req-1ad9f1e9-e1f5-495f-9005-2c58a8d6db79 tempest-AttachVolumeTestJSON-148826376 None] Deleting attachment 07ce6fe9-374d-4120-962a-5ad28c7650c2. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:01:46 devstack sudo[116633]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" returned: 0 in 6.387s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6e51c-4681-4a84-8244-3abdca26292a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:47 devstack sudo[116848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 Jun 20 00:01:47 devstack sudo[116848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Flow 'volume_create_manager' (5ec5a76c-511e-494f-b6c8-e71e901e5df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed07abdc-0904-43f4-9904-5ace471beb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed07abdc-0904-43f4-9904-5ace471beb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1637600647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23ced7f-df2a-440c-bcf4-d4760723c438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dd999b232346238e2ee0c60b10865b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:48Z,use_quota=True,user_id='23dcc64a22f24e4d9ddf863096a8f524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92f868c-e7f8-41ee-b5e0-12c1f5464f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92f868c-e7f8-41ee-b5e0-12c1f5464f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31fec8a-00fa-4e83-b412-87ec2791f515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31fec8a-00fa-4e83-b412-87ec2791f515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23ced7f-df2a-440c-bcf4-d4760723c438', 'volume_name': 'volume-a23ced7f-df2a-440c-bcf4-d4760723c438', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5605a865-45d1-41de-b592-4fe6267cfdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5605a865-45d1-41de-b592-4fe6267cfdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4627a7ee-1126-413b-84a5-a5265a9da315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:47 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Volume a23ced7f-df2a-440c-bcf4-d4760723c438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23ced7f-df2a-440c-bcf4-d4760723c438', 'volume_size': 1} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:47 devstack sudo[116848]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644" returned: 0 in 1.006s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:01:47 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Converted 1024.00 MB image at 160.29 MB/s Jun 20 00:01:47 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d is being set with open permissions: ugo+rw Jun 20 00:01:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:47 devstack sudo[116890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d Jun 20 00:01:47 devstack sudo[116890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:48 devstack sudo[116890]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" returned: 0 in 0.810s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" released by "_copy_volume_from_snapshot" :: held 10.118s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-987b9623-df84-4756-afae-e3ea1bdbdbbb" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-987b9623-df84-4756-afae-e3ea1bdbdbbb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Deleting offline snapshot 987b9623-df84-4756-afae-e3ea1bdbdbbb of volume 16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:01:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] snapshot_file for this snap is: volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:01:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2337f5c5-ac51-40d7-b79e-c0c92d1a4771]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:48 devstack sudo[116946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb Jun 20 00:01:48 devstack sudo[116946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:49 devstack sudo[116946]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb" returned: 0 in 0.774s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16530b00-5394-4fa3-9de3-9dd00af4f644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:01:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3761e457-e0fb-4485-b431-4fcf38f3ef68]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:49 devstack sudo[116976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 Jun 20 00:01:49 devstack sudo[116976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:50 devstack sudo[116976]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644" returned: 0 in 0.878s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:50 devstack sudo[117010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb Jun 20 00:01:50 devstack sudo[117010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:51 devstack sudo[117010]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb" returned: 0 in 0.718s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:51 devstack sudo[117037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb Jun 20 00:01:51 devstack sudo[117037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:51 devstack sudo[117037]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644.987b9623-df84-4756-afae-e3ea1bdbdbbb" returned: 0 in 0.637s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-987b9623-df84-4756-afae-e3ea1bdbdbbb" released by "_delete_snapshot" :: held 3.114s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.663s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.857s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231283493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc61d4f7-ebe3-4363-b925-8850457131ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:37Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Creating volume cc61d4f7-ebe3-4363-b925-8850457131ad {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:51 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae9dbbd-09ac-4ba7-adde-8269c4de68b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d', 'volume_size': 1, 'source_volid': '16530b00-5394-4fa3-9de3-9dd00af4f644', 'source_volstatus': 'available'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:51 devstack sudo[117061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad 1073741824 Jun 20 00:01:51 devstack sudo[117061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88714081-9539-4e9f-88a0-cb3d51e4edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:51 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Volume volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d (c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d): created successfully Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88714081-9539-4e9f-88a0-cb3d51e4edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (91f5f202-c766-4531-9bed-0ccef2f0c1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:52 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ca63a437-05e9-48d9-bc17-05536a27f254 tempest-VolumesGetTest-829185817 None] Created volume successfully. Jun 20 00:01:52 devstack sudo[117061]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad 1073741824" returned: 0 in 0.879s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:52 devstack sudo[117094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad Jun 20 00:01:52 devstack sudo[117094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (add02a7a-7f87-4850-af25-39d2d13ac24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624b0428-f278-4713-af0f-4c2deeb09620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624b0428-f278-4713-af0f-4c2deeb09620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1558006773',display_name='tempest-VolumesGetTest-Volume-1027925639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305a72ff-e5c5-4f89-8688-c0426ba9f7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:53Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fef6c2-78bc-4ce2-b732-ac9b7e9affef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fef6c2-78bc-4ce2-b732-ac9b7e9affef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05d5f64-3013-420a-be6d-85a610438c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05d5f64-3013-420a-be6d-85a610438c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305a72ff-e5c5-4f89-8688-c0426ba9f7e4', 'volume_name': 'volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ac6191-d53a-444b-81c9-426657237ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ac6191-d53a-444b-81c9-426657237ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0a09c7-10d8-48df-8612-f25d881dd133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:53 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Volume 305a72ff-e5c5-4f89-8688-c0426ba9f7e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4', 'volume_size': 1} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:53 devstack sudo[117094]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad" returned: 0 in 0.726s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.888s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1637600647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23ced7f-df2a-440c-bcf4-d4760723c438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dd999b232346238e2ee0c60b10865b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:48Z,use_quota=True,user_id='23dcc64a22f24e4d9ddf863096a8f524',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Creating volume a23ced7f-df2a-440c-bcf4-d4760723c438 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:53 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:53 devstack sudo[117121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 1073741824 Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a154b09f-f892-46c9-b00e-278fe2d8c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc61d4f7-ebe3-4363-b925-8850457131ad', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:53 devstack sudo[117121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ee1567-febb-42fd-8fdc-96ce2adb72bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:53 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Volume volume-cc61d4f7-ebe3-4363-b925-8850457131ad (cc61d4f7-ebe3-4363-b925-8850457131ad): created successfully Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ee1567-febb-42fd-8fdc-96ce2adb72bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (370db327-e19d-4729-80c3-ff688149cf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-82a710a3-7b12-400d-8a06-b51b1f4303c0 tempest-VolumesActionsTest-465421856 None] Created volume successfully. Jun 20 00:01:54 devstack sudo[117121]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 1073741824" returned: 0 in 0.840s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:54 devstack sudo[117152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 Jun 20 00:01:54 devstack sudo[117152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-cc61d4f7-ebe3-4363-b925-8850457131ad-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Lock "cinder-cc61d4f7-ebe3-4363-b925-8850457131ad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-quobyte-cc61d4f7-ebe3-4363-b925-8850457131ad" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Lock "cinder-quobyte-cc61d4f7-ebe3-4363-b925-8850457131ad" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[413fcd44-8ee4-489f-9625-34be04d35ae6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:54 devstack sudo[117163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad Jun 20 00:01:54 devstack sudo[117163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:55 devstack sudo[117152]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438" returned: 0 in 0.770s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.869s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1558006773',display_name='tempest-VolumesGetTest-Volume-1027925639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305a72ff-e5c5-4f89-8688-c0426ba9f7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:53Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Creating volume 305a72ff-e5c5-4f89-8688-c0426ba9f7e4 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:55 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4627a7ee-1126-413b-84a5-a5265a9da315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23ced7f-df2a-440c-bcf4-d4760723c438', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:55 devstack sudo[117182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 1073741824 Jun 20 00:01:55 devstack sudo[117182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95be49c5-f41f-46e2-a281-a7ba9c816a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:55 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Volume volume-a23ced7f-df2a-440c-bcf4-d4760723c438 (a23ced7f-df2a-440c-bcf4-d4760723c438): created successfully Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95be49c5-f41f-46e2-a281-a7ba9c816a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Flow 'volume_create_manager' (5ec5a76c-511e-494f-b6c8-e71e901e5df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:55 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0c98bda2-b8b2-4542-b6cf-b9fa8c47a09c tempest-VolumesNegativeTest-1547725153 None] Created volume successfully. Jun 20 00:01:55 devstack sudo[117163]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "cinder-6f3b374e-c49a-43c2-aa61-6205b3931b47-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad" returned: 0 in 0.894s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:55 devstack sudo[117199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad Jun 20 00:01:55 devstack sudo[117199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-6f3b374e-c49a-43c2-aa61-6205b3931b47-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "cinder-quobyte-6f3b374e-c49a-43c2-aa61-6205b3931b47" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-quobyte-6f3b374e-c49a-43c2-aa61-6205b3931b47" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdae3c2-41d3-45e2-b61b-366497e0e9f9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:55 devstack sudo[117204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 Jun 20 00:01:55 devstack sudo[117204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:56 devstack sudo[117182]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 1073741824" returned: 0 in 0.990s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:56 devstack sudo[117226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 Jun 20 00:01:56 devstack sudo[117226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:56 devstack sudo[117199]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cc61d4f7-ebe3-4363-b925-8850457131ad" returned: 0 in 0.791s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Lock "cinder-quobyte-cc61d4f7-ebe3-4363-b925-8850457131ad" released by "delete_volume" :: held 1.750s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Created reservations ['7ab35129-ee9e-4c74-9b8f-cee3ce08462c', '516d6f13-55af-43e1-ac42-786fe552120c', 'ee132fd6-647d-4b46-9159-a26364fc1cc6', '61e34d16-1fc0-488b-92f8-b440f0660a05'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:56 devstack sudo[117204]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:56 devstack sudo[117242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47" returned: 0 in 0.886s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:56 devstack sudo[117242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:56 devstack sudo[117244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47 Jun 20 00:01:56 devstack sudo[117244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:57 devstack sudo[117226]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4" returned: 0 in 0.914s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0a09c7-10d8-48df-8612-f25d881dd133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02049f34-784a-4661-badf-314ed73968cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:57 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Volume volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 (305a72ff-e5c5-4f89-8688-c0426ba9f7e4): created successfully Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02049f34-784a-4661-badf-314ed73968cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (add02a7a-7f87-4850-af25-39d2d13ac24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-18810b35-12bc-408c-8464-8ffe456954fa tempest-VolumesGetTest-829185817 None] Created volume successfully. Jun 20 00:01:57 devstack sudo[117244]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6f3b374e-c49a-43c2-aa61-6205b3931b47" returned: 0 in 0.831s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-quobyte-6f3b374e-c49a-43c2-aa61-6205b3931b47" released by "delete_volume" :: held 1.764s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Created reservations ['efc2ee27-c76b-4c5a-8c3f-9a6035daebf8', 'b2dd5c20-c9cb-4eea-b7e7-d300eda6d6a9', 'bc77c4b6-875e-456e-a6e7-63f24e20d231', '628a1a9e-f7af-4acd-9472-41ef3244800a'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:01:57 devstack sudo[117242]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.017s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Deleted volume successfully. Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (5428e0a8-f465-4f00-b169-f2173ac2ce1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79873e3-e796-4c0c-b61c-5eac36ff987b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-305a72ff-e5c5-4f89-8688-c0426ba9f7e4-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:57 devstack sudo[117285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:01:57 devstack sudo[117285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79873e3-e796-4c0c-b61c-5eac36ff987b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791138967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf934f3-6e27-49fd-add7-179ae6edc3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:58Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42c0815-4959-4b57-ae2c-ccbdb8b05e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42c0815-4959-4b57-ae2c-ccbdb8b05e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae38a1a-0a21-4a76-8406-82ac4861d4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae38a1a-0a21-4a76-8406-82ac4861d4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf934f3-6e27-49fd-add7-179ae6edc3d5', 'volume_name': 'volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90ac1f2-f0dd-4d66-ada9-3c30656b5b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90ac1f2-f0dd-4d66-ada9-3c30656b5b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40493ac-37da-4fa3-b973-d0cf8ad4dca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:01:57 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Volume 1cf934f3-6e27-49fd-add7-179ae6edc3d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5', 'volume_size': 1} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1791138967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf934f3-6e27-49fd-add7-179ae6edc3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:01:58Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Creating volume 1cf934f3-6e27-49fd-add7-179ae6edc3d5 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:01:57 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Lock "cinder-305a72ff-e5c5-4f89-8688-c0426ba9f7e4-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:57 devstack sudo[117290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 1073741824 Jun 20 00:01:57 devstack sudo[117290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bc4d03e5-3ae3-4353-bd25-7f5f91452c15 tempest-VolumesActionsTest-1381811945 None] Lock "cinder-cc61d4f7-ebe3-4363-b925-8850457131ad-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-305a72ff-e5c5-4f89-8688-c0426ba9f7e4" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-305a72ff-e5c5-4f89-8688-c0426ba9f7e4" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "cinder-3062b7bc-76dc-4537-a131-a8e08d5013db-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92962058-03e6-41a7-b028-e37455dfebf9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-3062b7bc-76dc-4537-a131-a8e08d5013db-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "cinder-quobyte-3062b7bc-76dc-4537-a131-a8e08d5013db" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-quobyte-3062b7bc-76dc-4537-a131-a8e08d5013db" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9846a14-33ec-4d31-9b1b-cac99408ba71]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:58 devstack sudo[117298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 Jun 20 00:01:58 devstack sudo[117298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:58 devstack sudo[117305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db Jun 20 00:01:58 devstack sudo[117305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:58 devstack sudo[117285]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.919s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:01:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Deleted volume successfully. Jun 20 00:01:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-498df515-93b7-4ad5-9ece-a54e5dda0556 tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-6f3b374e-c49a-43c2-aa61-6205b3931b47-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:59 devstack sudo[117298]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4" returned: 0 in 0.999s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:59 devstack sudo[117349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4 Jun 20 00:01:59 devstack sudo[117349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:59 devstack sudo[117290]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 1073741824" returned: 0 in 1.228s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:59 devstack sudo[117305]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db" returned: 0 in 0.962s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:01:59 devstack sudo[117354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 Jun 20 00:01:59 devstack sudo[117354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:59 devstack sudo[117356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db Jun 20 00:01:59 devstack sudo[117356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:01:59 devstack sudo[117349]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-305a72ff-e5c5-4f89-8688-c0426ba9f7e4" returned: 0 in 0.835s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-305a72ff-e5c5-4f89-8688-c0426ba9f7e4" released by "delete_volume" :: held 1.938s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:59 devstack sudo[117356]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3062b7bc-76dc-4537-a131-a8e08d5013db" returned: 0 in 0.732s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-quobyte-3062b7bc-76dc-4537-a131-a8e08d5013db" released by "delete_volume" :: held 1.761s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:01:59 devstack sudo[117354]: pam_unix(sudo:session): session closed for user root Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5" returned: 0 in 0.820s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.129s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:01:59 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Created reservations ['8717ebbd-68b6-45c2-a395-49effd5f7668', '4edee64b-7d5c-4d87-86fe-288f6b8c96ce', '27d0309d-9c06-49bc-bc7a-df1dcba43327', '721c4558-35ea-436c-81ce-0d8ae344c4d2'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40493ac-37da-4fa3-b973-d0cf8ad4dca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2fe648-44e7-4042-9c7c-6495408afe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Created reservations ['2f5c1f12-25c7-423c-93c8-f42cecf63895', '2fff5dee-e5ae-46b7-9511-475f4177024c', 'ce9813b3-40ca-4119-842f-e7daefbdb61e', '2364c9e1-b38a-421f-9b71-2139946f4633'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:00 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Volume volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 (1cf934f3-6e27-49fd-add7-179ae6edc3d5): created successfully Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb2fe648-44e7-4042-9c7c-6495408afe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (5428e0a8-f465-4f00-b169-f2173ac2ce1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:00 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c26e2a7c-d656-4538-b7e4-0908bb9e3f3e tempest-VolumesActionsTest-465421856 None] Created volume successfully. Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:00 devstack sudo[117390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:00 devstack sudo[117390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:00 devstack sudo[117393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:00 devstack sudo[117393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "cinder-1ae00bb6-7685-443f-a3c3-c1dbffe1f663-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-1ae00bb6-7685-443f-a3c3-c1dbffe1f663-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "cinder-quobyte-1ae00bb6-7685-443f-a3c3-c1dbffe1f663" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-quobyte-1ae00bb6-7685-443f-a3c3-c1dbffe1f663" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b839464-dc8b-44e2-b09f-ad6bad4a4d4e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:00 devstack sudo[117410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 Jun 20 00:02:00 devstack sudo[117410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:00 devstack sudo[117390]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.767s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:00 devstack sudo[117393]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.731s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:00 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Deleted volume successfully. Jun 20 00:02:00 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Deleted volume successfully. Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ec397552-d1bb-4925-8906-744edde63570 tempest-VolumesGetTest-829185817 None] Lock "cinder-305a72ff-e5c5-4f89-8688-c0426ba9f7e4-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-29a07342-fd56-485c-93ca-1e68ae1f24fd tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-3062b7bc-76dc-4537-a131-a8e08d5013db-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-1cf934f3-6e27-49fd-add7-179ae6edc3d5-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Lock "cinder-1cf934f3-6e27-49fd-add7-179ae6edc3d5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-quobyte-1cf934f3-6e27-49fd-add7-179ae6edc3d5" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Lock "cinder-quobyte-1cf934f3-6e27-49fd-add7-179ae6edc3d5" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e68d7-7fac-4bcf-8924-1c179188144d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Lock "cinder-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:01 devstack sudo[117429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 Jun 20 00:02:01 devstack sudo[117429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e3eefa-12cd-4f98-9162-a06b9a274378]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:01 devstack sudo[117434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d Jun 20 00:02:01 devstack sudo[117434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:01 devstack sudo[117410]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663" returned: 0 in 0.933s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:01 devstack sudo[117448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663 Jun 20 00:02:01 devstack sudo[117448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:01 devstack sudo[117429]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5" returned: 0 in 0.860s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:02 devstack sudo[117466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5 Jun 20 00:02:02 devstack sudo[117466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:02 devstack sudo[117434]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" returned: 0 in 0.914s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:02 devstack sudo[117477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d Jun 20 00:02:02 devstack sudo[117477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:02 devstack sudo[117448]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ae00bb6-7685-443f-a3c3-c1dbffe1f663" returned: 0 in 0.723s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-quobyte-1ae00bb6-7685-443f-a3c3-c1dbffe1f663" released by "delete_volume" :: held 1.719s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Created reservations ['0c69af2a-8cf2-477d-9920-3b2fccd769e0', '7293dc8c-03a8-49f5-a00a-9f64b9babcd9', '0af90db1-98f1-4935-93a4-4029a03ee81f', '21016202-6e65-4175-95cf-d9841fb4894e'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:02 devstack sudo[117488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:02 devstack sudo[117488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:02 devstack sudo[117466]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1cf934f3-6e27-49fd-add7-179ae6edc3d5" returned: 0 in 0.931s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Lock "cinder-quobyte-1cf934f3-6e27-49fd-add7-179ae6edc3d5" released by "delete_volume" :: held 1.869s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Created reservations ['4d70c07d-701e-4122-a3dc-700c41dbd7ed', '7efa9f08-4fc7-4dfc-85b9-75f9a35b22fe', 'd485f69c-ca8f-4a4a-8fec-5d81caf7f04d', 'babeb451-0895-4b45-9838-1367eb0ef2af'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:03 devstack sudo[117477]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" returned: 0 in 0.915s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d" released by "delete_volume" :: held 1.907s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Created reservations ['e462f62f-0b11-4e70-b987-84db7fee1b6c', '3495910f-b83c-4935-8357-580c610941e3', '2f141bd2-7505-4f23-a8f1-88c608e05127', '38570f42-0315-41e7-91c6-ef4e3efb2197'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:03 devstack sudo[117518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:03 devstack sudo[117518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:03 devstack sudo[117530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:03 devstack sudo[117530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:03 devstack sudo[117488]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.287s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Deleted volume successfully. Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-16530b00-5394-4fa3-9de3-9dd00af4f644-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Lock "cinder-16530b00-5394-4fa3-9de3-9dd00af4f644-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8faed8fe-223d-46b5-91a3-c9c6cb1c0ccd tempest-AttachVolumeTestJSON-148826376 None] Lock "cinder-1ae00bb6-7685-443f-a3c3-c1dbffe1f663-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-16530b00-5394-4fa3-9de3-9dd00af4f644" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-16530b00-5394-4fa3-9de3-9dd00af4f644" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaa39d1-a061-4e6b-a42a-fb63b198f703]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:04 devstack sudo[117546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 Jun 20 00:02:04 devstack sudo[117546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (7e0546bc-b26b-4ba6-9b40-f37182ee9442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fdf676-858d-4ebc-92a1-a19981f72a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fdf676-858d-4ebc-92a1-a19981f72a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-739140732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d567e19-a811-4ae4-9dbb-34311a59e42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:05Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c7084f-b628-4ece-b28b-aff993287560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c7084f-b628-4ece-b28b-aff993287560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a6e05c-24dc-4ac6-b572-633ed79938b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a6e05c-24dc-4ac6-b572-633ed79938b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d567e19-a811-4ae4-9dbb-34311a59e42f', 'volume_name': 'volume-9d567e19-a811-4ae4-9dbb-34311a59e42f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9129adbd-36d6-4c0e-9e67-9a5eddcd6f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9129adbd-36d6-4c0e-9e67-9a5eddcd6f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab78887-af9f-48ae-bbdc-3c0d96c50bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:05 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Volume 9d567e19-a811-4ae4-9dbb-34311a59e42f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d567e19-a811-4ae4-9dbb-34311a59e42f', 'volume_size': 1} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-739140732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d567e19-a811-4ae4-9dbb-34311a59e42f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:05Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Creating volume 9d567e19-a811-4ae4-9dbb-34311a59e42f {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:05 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:05 devstack sudo[117591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f 1073741824 Jun 20 00:02:05 devstack sudo[117591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:05 devstack sudo[117530]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.577s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Deleted volume successfully. Jun 20 00:02:05 devstack sudo[117518]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.876s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Deleted volume successfully. Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3d924904-85ff-47d8-be5b-c15efc000b73 tempest-VolumesGetTest-829185817 None] Lock "cinder-c9e71ba2-a779-4ece-ba4d-5bfa74e51a8d-delete_volume" released by "delete_volume" :: held 4.029s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1460869b-b928-4951-b514-b7bf45781d7e tempest-VolumesActionsTest-1381811945 None] Lock "cinder-1cf934f3-6e27-49fd-add7-179ae6edc3d5-delete_volume" released by "delete_volume" :: held 4.204s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:05 devstack sudo[117546]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644" returned: 0 in 1.213s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:05 devstack sudo[117600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644 Jun 20 00:02:05 devstack sudo[117600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:06 devstack sudo[117600]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-16530b00-5394-4fa3-9de3-9dd00af4f644" returned: 0 in 0.816s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-16530b00-5394-4fa3-9de3-9dd00af4f644" released by "delete_volume" :: held 2.137s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Created reservations ['f34f8396-f1f5-4d36-93f6-5d83fec95224', 'c6283cc3-7ce8-4966-932d-83e08d441e0e', 'e774f6d5-4811-425f-98e9-9edf6a035535', 'ef1372b8-ca40-4427-a2b9-7f818c164dbd'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:06 devstack sudo[117591]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f 1073741824" returned: 0 in 1.172s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:06 devstack sudo[117647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f Jun 20 00:02:06 devstack sudo[117647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:06 devstack sudo[117652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:06 devstack sudo[117652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:07 devstack sudo[117647]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f" returned: 0 in 0.902s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:07 devstack sudo[117652]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.833s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Deleted volume successfully. Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab78887-af9f-48ae-bbdc-3c0d96c50bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d567e19-a811-4ae4-9dbb-34311a59e42f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c83419f-b764-4a7c-9264-2ec095575290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-40872ea3-9608-48f1-bc8b-07cec14e492f tempest-VolumesGetTest-829185817 None] Lock "cinder-16530b00-5394-4fa3-9de3-9dd00af4f644-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:07 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Volume volume-9d567e19-a811-4ae4-9dbb-34311a59e42f (9d567e19-a811-4ae4-9dbb-34311a59e42f): created successfully Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c83419f-b764-4a7c-9264-2ec095575290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (7e0546bc-b26b-4ba6-9b40-f37182ee9442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c09a4107-11dc-4b7e-89bf-6d1cbb678d8c tempest-VolumesActionsTest-465421856 None] Created volume successfully. Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-9d567e19-a811-4ae4-9dbb-34311a59e42f-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Lock "cinder-9d567e19-a811-4ae4-9dbb-34311a59e42f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Acquiring lock "cinder-quobyte-9d567e19-a811-4ae4-9dbb-34311a59e42f" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Lock "cinder-quobyte-9d567e19-a811-4ae4-9dbb-34311a59e42f" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc12360f-84f5-48a6-814f-763b18b9fc55]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:08 devstack sudo[117707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f Jun 20 00:02:08 devstack sudo[117707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (9982cd26-bb01-4627-9d17-47ebb108395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8a297e-aac9-47c8-a7b8-c198346a315f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8a297e-aac9-47c8-a7b8-c198346a315f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1520367563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5030021-dc4d-422a-8c4d-676e3b3f9b8d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:09Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc2f78a-1553-4db1-b92d-454c003a9ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc2f78a-1553-4db1-b92d-454c003a9ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4838f50-6a5e-48f1-bfcb-d217b5ff9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:08 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4838f50-6a5e-48f1-bfcb-d217b5ff9272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5030021-dc4d-422a-8c4d-676e3b3f9b8d', 'volume_name': 'volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86e7edc-dd7e-4423-8dd9-ccdd77bbf6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86e7edc-dd7e-4423-8dd9-ccdd77bbf6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8699e3df-a690-49a3-947d-a53f3a30052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:09 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Volume f5030021-dc4d-422a-8c4d-676e3b3f9b8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Trying to clone f5030021-dc4d-422a-8c4d-676e3b3f9b8d from image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:02:09 devstack sudo[117707]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f" returned: 0 in 1.267s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:09 devstack sudo[117749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f Jun 20 00:02:09 devstack sudo[117749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:02:09 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Image download 20.69 MB at 20.69 MB/s Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffbe7ad-5bdd-4bc0-a1e6-fc4e3211b49e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:09 devstack sudo[117771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD Jun 20 00:02:09 devstack sudo[117771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:10 devstack sudo[117749]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9d567e19-a811-4ae4-9dbb-34311a59e42f" returned: 0 in 1.006s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Lock "cinder-quobyte-9d567e19-a811-4ae4-9dbb-34311a59e42f" released by "delete_volume" :: held 2.335s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Created reservations ['90d40eba-7673-4828-8a15-b923553f78c1', 'c86100ba-ae31-4422-a9c4-13922411266f', 'b2fc06ac-63a4-40f0-9045-4ed079411bce', '58fbe773-fb5e-4ec2-be77-768b2f2dbc00'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:10 devstack sudo[117792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:10 devstack sudo[117792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:10 devstack sudo[117771]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD" returned: 0 in 0.969s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Temporary image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec is fetched for user a89385573bf5409f92dab33a6dfa02e7. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be81e7ea-0c08-44a2-a626-8d6bfb4a6767]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:11 devstack sudo[117812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD Jun 20 00:02:11 devstack sudo[117812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:11 devstack sudo[117792]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.799s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:11 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Deleted volume successfully. Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c76fd5b1-cd36-4a89-b11c-9bf84476617e tempest-VolumesActionsTest-1381811945 None] Lock "cinder-9d567e19-a811-4ae4-9dbb-34311a59e42f-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:11 devstack sudo[117812]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD" returned: 0 in 0.856s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1520367563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5030021-dc4d-422a-8c4d-676e3b3f9b8d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:09Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Creating volume f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:11 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:11 devstack sudo[117848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d 1073741824 Jun 20 00:02:11 devstack sudo[117848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (bd829831-af81-496b-b9ac-c7a5649e6403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bf2fa2-975f-430b-8fdf-1a090a0ceee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bf2fa2-975f-430b-8fdf-1a090a0ceee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1253721345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:12Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da605989-9b6b-4ffd-9519-5b1907028192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da605989-9b6b-4ffd-9519-5b1907028192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ef6cbc-43ab-4e9b-9a6c-2b68cfcda928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ef6cbc-43ab-4e9b-9a6c-2b68cfcda928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c', 'volume_name': 'volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceec995-ddef-4a6b-960a-724ab0aaa35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ceec995-ddef-4a6b-960a-724ab0aaa35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a658ebee-f970-4553-9762-bb542e760aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:11 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Volume 73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c', 'volume_size': 1} Jun 20 00:02:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:12 devstack sudo[117848]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d 1073741824" returned: 0 in 0.937s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:12 devstack sudo[117898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d Jun 20 00:02:12 devstack sudo[117898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:14 devstack sudo[117898]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" returned: 0 in 1.421s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] <== create_volume: return (2416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.425s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1253721345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf6a112132b4a07b56474bf0d52ec0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:12Z,use_quota=True,user_id='bdb7937e1c2e451d80613cfe52041bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Creating volume 73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:14 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:14 devstack sudo[118042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c 1073741824 Jun 20 00:02:14 devstack sudo[118042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Attempting download of 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec ((None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}])) to volume f5030021-dc4d-422a-8c4d-676e3b3f9b8d. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Flow 'volume_create_manager' (0727f983-a7f1-40aa-ac74-1d48ba1e443c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1793ca0-bc63-4caa-93e3-5bd4441b1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1793ca0-bc63-4caa-93e3-5bd4441b1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1986015953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36114adb-e2f5-45db-9cd6-210227853bb6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c857cf644fa54dcea5126a4c8d31efbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:14Z,use_quota=True,user_id='ff2d350445f24138ba1e5158b6366d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f538774-7fbe-4927-b207-617684b8e9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f538774-7fbe-4927-b207-617684b8e9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4067bf96-e88e-485f-9fee-b89693d7ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4067bf96-e88e-485f-9fee-b89693d7ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36114adb-e2f5-45db-9cd6-210227853bb6', 'volume_name': 'volume-36114adb-e2f5-45db-9cd6-210227853bb6', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc142a7-4ff7-416f-b38d-369897b4eb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc142a7-4ff7-416f-b38d-369897b4eb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8503ff59-d4f1-4ed2-8a39-96fb69ba8c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:14 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Volume 36114adb-e2f5-45db-9cd6-210227853bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36114adb-e2f5-45db-9cd6-210227853bb6', 'volume_size': 1} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1266d372-903d-4054-a875-639fd9603cee]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_eik32wbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:14 devstack sudo[118052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_eik32wbf Jun 20 00:02:14 devstack sudo[118052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:15 devstack sudo[118042]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c 1073741824" returned: 0 in 0.969s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:15 devstack sudo[118087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c Jun 20 00:02:15 devstack sudo[118087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:15 devstack sudo[118052]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_eik32wbf" returned: 0 in 0.971s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_eik32wbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:15 devstack sudo[118095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_eik32wbf Jun 20 00:02:15 devstack sudo[118095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:16 devstack sudo[118087]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c" returned: 0 in 0.844s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.651s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1986015953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36114adb-e2f5-45db-9cd6-210227853bb6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c857cf644fa54dcea5126a4c8d31efbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:14Z,use_quota=True,user_id='ff2d350445f24138ba1e5158b6366d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Creating volume 36114adb-e2f5-45db-9cd6-210227853bb6 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:16 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a658ebee-f970-4553-9762-bb542e760aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:16 devstack sudo[118119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 1073741824 Jun 20 00:02:16 devstack sudo[118119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341efa76-0963-4767-87be-31054cf25494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:16 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Volume volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c (73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c): created successfully Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341efa76-0963-4767-87be-31054cf25494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Flow 'volume_create_manager' (bd829831-af81-496b-b9ac-c7a5649e6403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:16 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8f039cfa-fab0-4aaa-b7e1-fb692e6010bd tempest-VolumesActionsTest-465421856 None] Created volume successfully. Jun 20 00:02:16 devstack sudo[118095]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_eik32wbf" returned: 1 in 1.064s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_eik32wbf' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cb9d17-5aa8-4270-ae40-d49f385d60f6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:16 devstack sudo[118135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD Jun 20 00:02:16 devstack sudo[118135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Acquiring lock "cinder-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Lock "cinder-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Acquiring lock "cinder-quobyte-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Lock "cinder-quobyte-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c" acquired by "delete_volume" :: waited 0.035s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:17 devstack sudo[118135]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD" returned: 0 in 1.159s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec was qcow2, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:02:17 devstack sudo[118119]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd40ed16-2665-4eee-ac75-4de37bbded3e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 1073741824" returned: 0 in 1.601s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:17 devstack sudo[118177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d Jun 20 00:02:17 devstack sudo[118177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:17 devstack sudo[118183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 Jun 20 00:02:17 devstack sudo[118183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:17 devstack sudo[118178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c Jun 20 00:02:17 devstack sudo[118178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:18 devstack sudo[118183]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6" returned: 0 in 0.895s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] <== create_volume: return (2579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.585s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8503ff59-d4f1-4ed2-8a39-96fb69ba8c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36114adb-e2f5-45db-9cd6-210227853bb6', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849bb1ae-10c0-4747-b382-867ed24b05cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:18 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Volume volume-36114adb-e2f5-45db-9cd6-210227853bb6 (36114adb-e2f5-45db-9cd6-210227853bb6): created successfully Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849bb1ae-10c0-4747-b382-867ed24b05cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Flow 'volume_create_manager' (0727f983-a7f1-40aa-ac74-1d48ba1e443c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-20c238c7-af2d-4dd5-a69a-e2bb7ab2a6db tempest-VolumesTestJSON-1245685709 None] Created volume successfully. Jun 20 00:02:18 devstack sudo[118178]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c" returned: 0 in 1.225s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:18 devstack sudo[118248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c Jun 20 00:02:18 devstack sudo[118248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:19 devstack sudo[118248]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c" returned: 0 in 0.958s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Lock "cinder-quobyte-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c" released by "delete_volume" :: held 2.273s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:19 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Created reservations ['ac82ef30-cfb3-4c99-b6d2-69ab9bb2ae08', 'de396279-f136-4d82-9f8e-79afc1940847', 'c10c6c2f-e5e6-4f55-8574-3a71ef9e4008', '32e8a2ec-59f1-46b4-b926-ec1d1ce61757'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:20 devstack sudo[118302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:20 devstack sudo[118302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Flow 'volume_create_manager' (01176743-86d3-4a35-8b74-691aa82cb471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e1c15e-82c8-43a6-9310-6f8a957af223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:20 devstack sudo[118177]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" returned: 0 in 2.849s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_ky9_948kdevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:02:20 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Converted 112.00 MB image at 39.29 MB/s Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e1c15e-82c8-43a6-9310-6f8a957af223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-767569947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9b90fd-e5fe-4c1a-babb-58127f58d226,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c857cf644fa54dcea5126a4c8d31efbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:20Z,use_quota=True,user_id='ff2d350445f24138ba1e5158b6366d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5adbaf-71c1-43dd-939a-4537b160f58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:20 devstack sudo[118317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d 1G Jun 20 00:02:20 devstack sudo[118317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5adbaf-71c1-43dd-939a-4537b160f58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cf9b49-3097-48d1-a5a1-880c36f5fae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61cf9b49-3097-48d1-a5a1-880c36f5fae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9b90fd-e5fe-4c1a-babb-58127f58d226', 'volume_name': 'volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d821b6f-a2d3-42f0-a3fd-6572a3af2c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d821b6f-a2d3-42f0-a3fd-6572a3af2c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595a4748-5ec9-446e-b668-e85c3534daa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:20 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Volume 9c9b90fd-e5fe-4c1a-babb-58127f58d226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226', 'volume_size': 1} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-767569947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9b90fd-e5fe-4c1a-babb-58127f58d226,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c857cf644fa54dcea5126a4c8d31efbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:20Z,use_quota=True,user_id='ff2d350445f24138ba1e5158b6366d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Creating volume 9c9b90fd-e5fe-4c1a-babb-58127f58d226 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:20 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:20 devstack sudo[118322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 1073741824 Jun 20 00:02:20 devstack sudo[118322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:21 devstack sudo[118302]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.250s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:21 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Deleted volume successfully. Jun 20 00:02:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3906ed22-1a43-4e95-a9f8-037b04e3e5d9 tempest-VolumesActionsTest-465421856 None] Lock "cinder-73ebca92-652f-4c6b-a9f6-3bcf1acfbb2c-delete_volume" released by "delete_volume" :: held 3.863s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:21 devstack sudo[118317]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d 1G" returned: 0 in 1.046s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:21 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[281dcb6c-5aa7-4631-8196-56f554da7223]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:21 devstack sudo[118322]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 1073741824" returned: 0 in 1.080s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:21 devstack sudo[118363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d Jun 20 00:02:21 devstack sudo[118363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:21 devstack sudo[118368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 Jun 20 00:02:21 devstack sudo[118368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:22 devstack sudo[118363]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" returned: 0 in 0.889s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:22 devstack sudo[118368]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226" returned: 0 in 0.775s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595a4748-5ec9-446e-b668-e85c3534daa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf4e49f-9412-47d8-9d16-38138042fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:22 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Volume volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 (9c9b90fd-e5fe-4c1a-babb-58127f58d226): created successfully Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf4e49f-9412-47d8-9d16-38138042fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Flow 'volume_create_manager' (01176743-86d3-4a35-8b74-691aa82cb471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:22 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d057808c-0a24-4131-9785-61f2b95b11ca tempest-VolumesTestJSON-1245685709 None] Created volume successfully. Jun 20 00:02:22 devstack sudo[118397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d Jun 20 00:02:22 devstack sudo[118397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:23 devstack sudo[118397]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" returned: 1 in 0.835s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Downloaded image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec ((None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}])) to volume f5030021-dc4d-422a-8c4d-676e3b3f9b8d successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Temporary image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec for user a89385573bf5409f92dab33a6dfa02e7 is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Marking volume f5030021-dc4d-422a-8c4d-676e3b3f9b8d as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Copying metadata from image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec to f5030021-dc4d-422a-8c4d-676e3b3f9b8d. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Creating volume glance metadata for volume f5030021-dc4d-422a-8c4d-676e3b3f9b8d backed by image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8699e3df-a690-49a3-947d-a53f3a30052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39970fef-2440-42e7-a8a6-2eed5033e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:23 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Volume volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d (f5030021-dc4d-422a-8c4d-676e3b3f9b8d): created successfully Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39970fef-2440-42e7-a8a6-2eed5033e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (9982cd26-bb01-4627-9d17-47ebb108395d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:23 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-124e8ef3-7199-4713-8dbe-a938b47f9db1 tempest-VolumesGetTest-829185817 None] Created volume successfully. Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Flow 'volume_create_manager' (0e32f422-bfb8-4306-8470-0ebde83d19b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90640b9-7843-4d9f-a976-4819d5020f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e90640b9-7843-4d9f-a976-4819d5020f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-997274544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41e0972-64fc-4169-b381-ca804f0dba75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c857cf644fa54dcea5126a4c8d31efbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:24Z,use_quota=True,user_id='ff2d350445f24138ba1e5158b6366d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea71cb1c-5744-4f03-8d2b-0bc988cf5ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea71cb1c-5744-4f03-8d2b-0bc988cf5ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e917796-d32c-4ef2-a826-c9d8f7004daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e917796-d32c-4ef2-a826-c9d8f7004daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41e0972-64fc-4169-b381-ca804f0dba75', 'volume_name': 'volume-a41e0972-64fc-4169-b381-ca804f0dba75', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d99bc67-6495-4a55-9462-fb0b64ff6d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d99bc67-6495-4a55-9462-fb0b64ff6d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b338999d-2d62-4324-8879-3d6121230efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:24 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Volume a41e0972-64fc-4169-b381-ca804f0dba75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41e0972-64fc-4169-b381-ca804f0dba75', 'volume_size': 1} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-997274544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41e0972-64fc-4169-b381-ca804f0dba75,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c857cf644fa54dcea5126a4c8d31efbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:24Z,use_quota=True,user_id='ff2d350445f24138ba1e5158b6366d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Creating volume a41e0972-64fc-4169-b381-ca804f0dba75 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:24 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:24 devstack sudo[118463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 1073741824 Jun 20 00:02:24 devstack sudo[118463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (ef3b8946-03e3-4117-8562-6caa1c370106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0767af86-d53e-496e-a99b-a62db0dc75c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0767af86-d53e-496e-a99b-a62db0dc75c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1713547181',display_name='tempest-VolumesGetTest-Volume-1827843061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65325237-e59e-4440-8d22-382df242b724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:25Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942694da-ae0f-4611-a320-852b9056f9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942694da-ae0f-4611-a320-852b9056f9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410c386c-75d1-4a41-bba0-236dc2306cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410c386c-75d1-4a41-bba0-236dc2306cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65325237-e59e-4440-8d22-382df242b724', 'volume_name': 'volume-65325237-e59e-4440-8d22-382df242b724', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5235354e-f484-47cc-915b-418f9995d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5235354e-f484-47cc-915b-418f9995d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2365f0-4d19-4b31-8ad0-c6a002520e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:25 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Volume 65325237-e59e-4440-8d22-382df242b724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65325237-e59e-4440-8d22-382df242b724', 'volume_size': 1} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:25 devstack sudo[118463]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 1073741824" returned: 0 in 1.028s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:25 devstack sudo[118504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 Jun 20 00:02:25 devstack sudo[118504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:26 devstack sudo[118504]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75" returned: 0 in 0.709s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1713547181',display_name='tempest-VolumesGetTest-Volume-1827843061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65325237-e59e-4440-8d22-382df242b724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fcea448bfd42b1a7801d8e56232f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:25Z,use_quota=True,user_id='a89385573bf5409f92dab33a6dfa02e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Creating volume 65325237-e59e-4440-8d22-382df242b724 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:26 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b338999d-2d62-4324-8879-3d6121230efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41e0972-64fc-4169-b381-ca804f0dba75', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5e9479-4b5a-41c6-b028-1b9b867d3c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:26 devstack sudo[118529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 1073741824 Jun 20 00:02:26 devstack sudo[118529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:26 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Volume volume-a41e0972-64fc-4169-b381-ca804f0dba75 (a41e0972-64fc-4169-b381-ca804f0dba75): created successfully Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5e9479-4b5a-41c6-b028-1b9b867d3c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:26 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Flow 'volume_create_manager' (0e32f422-bfb8-4306-8470-0ebde83d19b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:26 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f6d9033b-6158-4580-a19b-239335f9ec90 tempest-VolumesTestJSON-1245685709 None] Created volume successfully. Jun 20 00:02:27 devstack sudo[118529]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 1073741824" returned: 0 in 0.973s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:27 devstack sudo[118566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 Jun 20 00:02:27 devstack sudo[118566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:28 devstack sudo[118589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:28 devstack sudo[118589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:28 devstack sudo[118566]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724" returned: 0 in 0.938s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2365f0-4d19-4b31-8ad0-c6a002520e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65325237-e59e-4440-8d22-382df242b724', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041fe89b-0f51-43d8-a733-760553388250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:28 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Volume volume-65325237-e59e-4440-8d22-382df242b724 (65325237-e59e-4440-8d22-382df242b724): created successfully Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041fe89b-0f51-43d8-a733-760553388250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Flow 'volume_create_manager' (ef3b8946-03e3-4117-8562-6caa1c370106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:28 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-22bd0af8-cbf5-4ed5-af19-23377d54f17d tempest-VolumesGetTest-829185817 None] Created volume successfully. Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Acquiring lock "cinder-a41e0972-64fc-4169-b381-ca804f0dba75-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Lock "cinder-a41e0972-64fc-4169-b381-ca804f0dba75-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Acquiring lock "cinder-quobyte-a41e0972-64fc-4169-b381-ca804f0dba75" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Lock "cinder-quobyte-a41e0972-64fc-4169-b381-ca804f0dba75" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a39e29-7f05-422b-ab8b-33e7e1fef0a8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:29 devstack sudo[118620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 Jun 20 00:02:29 devstack sudo[118620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:29 devstack sudo[118589]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.095s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-65325237-e59e-4440-8d22-382df242b724-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Lock "cinder-65325237-e59e-4440-8d22-382df242b724-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-65325237-e59e-4440-8d22-382df242b724" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-65325237-e59e-4440-8d22-382df242b724" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99ea2d2-c03c-44aa-9695-df7319ba5a99]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:29 devstack sudo[118649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 Jun 20 00:02:29 devstack sudo[118649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:30 devstack sudo[118620]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75" returned: 0 in 1.091s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:30 devstack sudo[118661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75 Jun 20 00:02:30 devstack sudo[118661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:30 devstack sudo[118649]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724" returned: 0 in 1.057s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:30 devstack sudo[118690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724 Jun 20 00:02:30 devstack sudo[118690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:30 devstack sudo[118661]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a41e0972-64fc-4169-b381-ca804f0dba75" returned: 0 in 0.885s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Lock "cinder-quobyte-a41e0972-64fc-4169-b381-ca804f0dba75" released by "delete_volume" :: held 2.048s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Created reservations ['70319e23-920c-4192-9e71-537608ce29d8', 'f95d6354-e9ce-4e83-b64d-53c93a2f0e31', '986b6749-bcdd-46a4-ab6a-df5f414652f0', '45c5f74c-a199-448b-9180-9d4dc4673e28'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:31 devstack sudo[118704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:31 devstack sudo[118704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:31 devstack sudo[118690]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-65325237-e59e-4440-8d22-382df242b724" returned: 0 in 0.814s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-65325237-e59e-4440-8d22-382df242b724" released by "delete_volume" :: held 1.951s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Created reservations ['53bd144b-32ef-4e6f-aa87-af0689343393', '1c46a64b-7ca0-4457-89fa-afe685817a8c', '2b821f76-a6a8-48ae-980e-2e167da64de2', '08c79636-fd8d-4234-8c7f-fbf21d714e04'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:31 devstack sudo[118729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:31 devstack sudo[118729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-f5030021-dc4d-422a-8c4d-676e3b3f9b8d-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:32 devstack sudo[118704]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.976s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Lock "cinder-f5030021-dc4d-422a-8c4d-676e3b3f9b8d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Deleted volume successfully. Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ffece6e1-7855-4605-bd98-7b7809db4f1d tempest-VolumesTestJSON-1245685709 None] Lock "cinder-a41e0972-64fc-4169-b381-ca804f0dba75-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Acquiring lock "cinder-9c9b90fd-e5fe-4c1a-babb-58127f58d226-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Acquiring lock "cinder-quobyte-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Lock "cinder-9c9b90fd-e5fe-4c1a-babb-58127f58d226-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" acquired by "delete_volume" :: waited 0.047s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Acquiring lock "cinder-quobyte-9c9b90fd-e5fe-4c1a-babb-58127f58d226" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[468f9792-719a-461a-a687-ee4a6e87241e]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Lock "cinder-quobyte-9c9b90fd-e5fe-4c1a-babb-58127f58d226" acquired by "delete_volume" :: waited 0.047s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[538795e9-6274-46f1-8d12-b794ad32b62c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:32 devstack sudo[118746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d Jun 20 00:02:32 devstack sudo[118746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:32 devstack sudo[118750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 Jun 20 00:02:32 devstack sudo[118750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:33 devstack sudo[118729]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.124s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:33 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:33 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Deleted volume successfully. Jun 20 00:02:33 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-97a34b47-cb81-4cda-a579-b08c229be4ce tempest-VolumesGetTest-829185817 None] Lock "cinder-65325237-e59e-4440-8d22-382df242b724-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:33 devstack sudo[118746]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" returned: 0 in 1.169s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:33 devstack sudo[118750]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226" returned: 0 in 1.104s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:33 devstack sudo[118793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226 Jun 20 00:02:33 devstack sudo[118793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:33 devstack sudo[118789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d Jun 20 00:02:33 devstack sudo[118789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Acquiring lock "cinder-a23ced7f-df2a-440c-bcf4-d4760723c438-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Lock "cinder-a23ced7f-df2a-440c-bcf4-d4760723c438-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Acquiring lock "cinder-quobyte-a23ced7f-df2a-440c-bcf4-d4760723c438" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Lock "cinder-quobyte-a23ced7f-df2a-440c-bcf4-d4760723c438" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8bc674-f2a7-4322-9795-a5d1a8e9f043]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:34 devstack sudo[118824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 Jun 20 00:02:34 devstack sudo[118824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:34 devstack sudo[118793]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9c9b90fd-e5fe-4c1a-babb-58127f58d226" returned: 0 in 0.977s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Lock "cinder-quobyte-9c9b90fd-e5fe-4c1a-babb-58127f58d226" released by "delete_volume" :: held 2.170s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:34 devstack sudo[118789]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" returned: 1 in 1.029s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:34 devstack sudo[118831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d Jun 20 00:02:34 devstack sudo[118831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Created reservations ['c179e9b6-f2d6-4c00-bccd-bf1acbc0b3f0', '9548106f-8008-4f9d-895e-2ddbf58cb979', '1f215dbe-c8c0-42fb-ba13-973272c99f50', 'de3c2a3d-858a-432f-8d92-a40c33bd0fc6'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:34 devstack sudo[118837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:34 devstack sudo[118837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:35 devstack sudo[118824]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438" returned: 0 in 1.008s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:35 devstack sudo[118831]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" returned: 0 in 0.837s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:35 devstack sudo[118866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438 Jun 20 00:02:35 devstack sudo[118866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Lock "cinder-quobyte-f5030021-dc4d-422a-8c4d-676e3b3f9b8d" released by "delete_volume" :: held 3.165s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Created reservations ['c9991e6a-2854-4369-8aed-62087c09651c', '412ba933-68e3-423d-ba16-259eb5476d54', '4c29f728-61aa-4800-b90f-1a24c37f007a', 'be1d3391-caaa-4663-bd8c-18ae95728707'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:35 devstack sudo[118837]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.915s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:35 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Deleted volume successfully. Jun 20 00:02:35 devstack sudo[118875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:35 devstack sudo[118875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Acquiring lock "cinder-36114adb-e2f5-45db-9cd6-210227853bb6-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c29d0545-61c2-4572-ab3c-9ae355568986 tempest-VolumesTestJSON-1245685709 None] Lock "cinder-9c9b90fd-e5fe-4c1a-babb-58127f58d226-delete_volume" released by "delete_volume" :: held 3.475s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Lock "cinder-36114adb-e2f5-45db-9cd6-210227853bb6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Acquiring lock "cinder-quobyte-36114adb-e2f5-45db-9cd6-210227853bb6" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Lock "cinder-quobyte-36114adb-e2f5-45db-9cd6-210227853bb6" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[011093a0-2f7e-4847-bae8-edcec9b1a255]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:36 devstack sudo[118885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 Jun 20 00:02:36 devstack sudo[118885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:36 devstack sudo[118866]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a23ced7f-df2a-440c-bcf4-d4760723c438" returned: 0 in 0.936s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Lock "cinder-quobyte-a23ced7f-df2a-440c-bcf4-d4760723c438" released by "delete_volume" :: held 2.004s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Created reservations ['3b294b7e-83fb-4327-8adb-da021002e3f7', '97d4c3bf-7444-4d54-b1a8-fb25305e3ecc', 'b23968f7-26ab-4a22-a77a-ca0a5bb2fd85', '72f9af1a-f674-439f-8870-fbd2aa5656ce'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:36 devstack sudo[118875]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.860s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:36 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Deleted volume successfully. Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f20082f9-22f0-46a2-a525-cf0260909643 tempest-VolumesGetTest-829185817 None] Lock "cinder-f5030021-dc4d-422a-8c4d-676e3b3f9b8d-delete_volume" released by "delete_volume" :: held 4.442s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:36 devstack sudo[118908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:36 devstack sudo[118908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:36 devstack sudo[118885]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6" returned: 0 in 0.951s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:36 devstack sudo[118922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6 Jun 20 00:02:36 devstack sudo[118922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:37 devstack sudo[118908]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.820s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:37 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Deleted volume successfully. Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-04955041-f810-45b0-85c8-32f7c6072b19 tempest-VolumesNegativeTest-1547725153 None] Lock "cinder-a23ced7f-df2a-440c-bcf4-d4760723c438-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:37 devstack sudo[118922]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-36114adb-e2f5-45db-9cd6-210227853bb6" returned: 0 in 0.820s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Lock "cinder-quobyte-36114adb-e2f5-45db-9cd6-210227853bb6" released by "delete_volume" :: held 1.824s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Created reservations ['5105a687-2eb9-4834-b863-445fd6762eab', '8b85d561-751b-4235-9c23-32fed90a54fd', 'db641b89-bb61-4e1f-b186-e5a580478344', 'af1fa9c9-16ba-430c-97c9-e8d2d7cc64d9'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:37 devstack sudo[118956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:02:37 devstack sudo[118956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Flow 'volume_create_manager' (4f71fc4f-f33f-4c9b-80ab-59c217be953e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9e11d8-7eab-4ef2-902c-8fe46cc81aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed9e11d8-7eab-4ef2-902c-8fe46cc81aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-146799972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e174c004-ead9-4b9b-99af-0b324c1f1cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec440a5da61b496c906d35f4e1aa2f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:38Z,use_quota=True,user_id='3ae90164cf4f4a36b02c264afca6c3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee3d30e-eca4-4462-ae0b-e684686c067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee3d30e-eca4-4462-ae0b-e684686c067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757d852b-f413-4137-9aab-0fbd1bd7c642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757d852b-f413-4137-9aab-0fbd1bd7c642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e174c004-ead9-4b9b-99af-0b324c1f1cd4', 'volume_name': 'volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70ccf6b-f2b0-46f1-9af9-9c845d3badac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70ccf6b-f2b0-46f1-9af9-9c845d3badac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6846eb-2249-456e-b8b1-fea63c84d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:38 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Volume e174c004-ead9-4b9b-99af-0b324c1f1cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4', 'volume_size': 1} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-146799972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e174c004-ead9-4b9b-99af-0b324c1f1cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec440a5da61b496c906d35f4e1aa2f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:38Z,use_quota=True,user_id='3ae90164cf4f4a36b02c264afca6c3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Creating volume e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:38 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:38 devstack sudo[118972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 1073741824 Jun 20 00:02:38 devstack sudo[118972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:38 devstack sudo[118956]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.028s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:38 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:02:38 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Deleted volume successfully. Jun 20 00:02:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-77fa514a-ced0-4c89-9589-7fce32e94a0c tempest-VolumesTestJSON-1245685709 None] Lock "cinder-36114adb-e2f5-45db-9cd6-210227853bb6-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:39 devstack sudo[118972]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 1073741824" returned: 0 in 1.364s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:39 devstack sudo[119022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 Jun 20 00:02:39 devstack sudo[119022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:40 devstack sudo[119022]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4" returned: 0 in 0.849s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] <== create_volume: return (2306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.309s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=109,cinder:INSERT=51,cinder:UPDATE=174,cinder:DELETE=12 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6846eb-2249-456e-b8b1-fea63c84d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64193de6-61ac-4cfd-b5ef-84b9fb1ac0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=124,cinder:INSERT=43,cinder:UPDATE=177,cinder:DELETE=17 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:02:40 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Volume volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 (e174c004-ead9-4b9b-99af-0b324c1f1cd4): created successfully Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64193de6-61ac-4cfd-b5ef-84b9fb1ac0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Flow 'volume_create_manager' (4f71fc4f-f33f-4c9b-80ab-59c217be953e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6276bf6e-b0a0-4c33-bf37-747de9205b6b tempest-VolumesDeleteCascade-1060669598 None] Created volume successfully. Jun 20 00:02:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Creating offline snapshot 1448318e-3076-41a9-9471-99478dfbeb2a of volume e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:02:41 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6b48e0-dab4-41c7-83cb-7283844675f6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:41 devstack sudo[119085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 Jun 20 00:02:41 devstack sudo[119085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:42 devstack sudo[119085]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4" returned: 0 in 1.185s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:42 devstack sudo[119123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a 1G Jun 20 00:02:42 devstack sudo[119123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:43 devstack sudo[119123]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a 1G" returned: 0 in 0.954s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:43 devstack sudo[119159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a Jun 20 00:02:43 devstack sudo[119159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:44 devstack sudo[119159]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a" returned: 0 in 0.859s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:44 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a is being set with open permissions: ugo+rw Jun 20 00:02:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:44 devstack sudo[119190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a Jun 20 00:02:44 devstack sudo[119190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-48119312-e392-4d86-b987-446bd9bd21c9 tempest-BackendsCapabilitiesAdminTestsJSON-323252495 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93391) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 20 00:02:45 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b70e55b2-3a25-4a3c-acf7-73c2f15ac567 tempest-BackendsCapabilitiesAdminTestsJSON-323252495 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757827758789, 'free_capacity_gb': 1775.757827758789, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93391) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 20 00:02:45 devstack sudo[119190]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a" returned: 0 in 0.839s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:45 devstack sudo[119221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.info Jun 20 00:02:45 devstack sudo[119221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:46 devstack sudo[119221]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.info" returned: 0 in 0.900s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:46 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.info is being set with open permissions: ugo+rw Jun 20 00:02:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:46 devstack sudo[119251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.info Jun 20 00:02:46 devstack sudo[119251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:47 devstack sudo[119251]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.info" returned: 0 in 0.745s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.600s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:47 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c51f785f-0afd-4ebb-8870-e7e99e2a5937 tempest-VolumesDeleteCascade-1060669598 None] Create snapshot completed successfully Jun 20 00:02:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Creating offline snapshot 08c478c8-052b-48bb-848a-ae1dbad577ae of volume e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:02:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2458da-c416-414c-b490-5a99612403b8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:48 devstack sudo[119308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a Jun 20 00:02:48 devstack sudo[119308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:49 devstack sudo[119308]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a" returned: 0 in 0.908s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:02:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:49 devstack sudo[119340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae 1G Jun 20 00:02:49 devstack sudo[119340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:50 devstack sudo[119340]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae 1G" returned: 0 in 1.013s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:50 devstack sudo[119380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae Jun 20 00:02:50 devstack sudo[119380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:51 devstack sudo[119380]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae" returned: 0 in 0.918s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:51 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae is being set with open permissions: ugo+rw Jun 20 00:02:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:51 devstack sudo[119412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae Jun 20 00:02:51 devstack sudo[119412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:52 devstack sudo[119412]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae" returned: 0 in 0.847s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.842s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:52 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-09b21931-636a-4120-944f-679f6745484c tempest-VolumesDeleteCascade-1060669598 None] Create snapshot completed successfully Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-e174c004-ead9-4b9b-99af-0b324c1f1cd4-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-e174c004-ead9-4b9b-99af-0b324c1f1cd4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Performing cascade delete. {{(pid=93391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-08c478c8-052b-48bb-848a-ae1dbad577ae-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-08c478c8-052b-48bb-848a-ae1dbad577ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-08c478c8-052b-48bb-848a-ae1dbad577ae" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-08c478c8-052b-48bb-848a-ae1dbad577ae" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Deleting offline snapshot 08c478c8-052b-48bb-848a-ae1dbad577ae of volume e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] snapshot_file for this snap is: volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[90248139-f8b8-4e95-8648-edd0fe5a0baf]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:53 devstack sudo[119466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae Jun 20 00:02:53 devstack sudo[119466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (48d42c99-7b7c-4c38-969d-8fd58cf92f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0838abb7-58ac-4cd5-ab7b-a0e362196b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0838abb7-58ac-4cd5-ab7b-a0e362196b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1083885125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee9b8fe-fe1a-44eb-8897-d675024e3811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79014f628b8c464a82c5df6b1988f1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:53Z,use_quota=True,user_id='93589cee300c404faaa654226956c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26000886-5477-4882-84ac-a7fa81700d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26000886-5477-4882-84ac-a7fa81700d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd03816-2f53-4920-a955-6ecdefc715ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd03816-2f53-4920-a955-6ecdefc715ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee9b8fe-fe1a-44eb-8897-d675024e3811', 'volume_name': 'volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852300f6-0e0f-4f1c-8069-d95bc54a1c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852300f6-0e0f-4f1c-8069-d95bc54a1c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6a955e-e651-4333-96b7-53587822053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:53 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume 9ee9b8fe-fe1a-44eb-8897-d675024e3811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811', 'volume_size': 1} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1083885125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee9b8fe-fe1a-44eb-8897-d675024e3811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79014f628b8c464a82c5df6b1988f1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:02:53Z,use_quota=True,user_id='93589cee300c404faaa654226956c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Creating volume 9ee9b8fe-fe1a-44eb-8897-d675024e3811 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:02:53 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:02:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:53 devstack sudo[119485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 1073741824 Jun 20 00:02:53 devstack sudo[119485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:54 devstack sudo[119466]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae" returned: 0 in 1.329s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:02:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b458e87-1b84-4a1c-acff-de76157ac0ac]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:54 devstack sudo[119513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a Jun 20 00:02:54 devstack sudo[119513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:54 devstack sudo[119485]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 1073741824" returned: 0 in 1.285s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:54 devstack sudo[119536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 Jun 20 00:02:54 devstack sudo[119536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:55 devstack sudo[119536]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:55 devstack sudo[119513]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811" returned: 0 in 0.895s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a" returned: 0 in 1.447s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:55 devstack sudo[119570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae Jun 20 00:02:55 devstack sudo[119570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6a955e-e651-4333-96b7-53587822053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aa41fd-26f8-4424-8bad-66625383edd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:02:55 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 (9ee9b8fe-fe1a-44eb-8897-d675024e3811): created successfully Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aa41fd-26f8-4424-8bad-66625383edd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:02:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (48d42c99-7b7c-4c38-969d-8fd58cf92f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:02:55 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2b8f96c3-a24c-4d4e-9992-aaf80a3f9ca0 tempest-VolumesSnapshotTestJSON-1211356176 None] Created volume successfully. Jun 20 00:02:56 devstack sudo[119570]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae" returned: 0 in 1.048s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:56 devstack sudo[119605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae Jun 20 00:02:56 devstack sudo[119605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:02:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:02:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Creating offline snapshot 1a028eb0-3246-4baa-b148-7d109f722e7e of volume 9ee9b8fe-fe1a-44eb-8897-d675024e3811 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:02:57 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[566b6123-8a24-4411-8381-6b546bb59826]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:57 devstack sudo[119613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 Jun 20 00:02:57 devstack sudo[119613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:57 devstack sudo[119605]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.08c478c8-052b-48bb-848a-ae1dbad577ae" returned: 0 in 0.917s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-08c478c8-052b-48bb-848a-ae1dbad577ae" released by "_delete_snapshot" :: held 4.957s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" released by "delete_snapshot" :: held 5.030s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:57 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Created reservations ['88c1512a-2c7f-43da-a950-4410447e388a', '21f07e4e-bfcd-4547-8595-ce8eb1cacef2', 'eefe93d1-cbc4-4625-a263-b2455f5f92c3', '691c9b06-9d74-4f9d-88d0-0726c8d29048'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:02:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Delete snapshot completed successfully. Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-08c478c8-052b-48bb-848a-ae1dbad577ae-delete_snapshot" released by "delete_snapshot" :: held 5.357s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-1448318e-3076-41a9-9471-99478dfbeb2a-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-1448318e-3076-41a9-9471-99478dfbeb2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-1448318e-3076-41a9-9471-99478dfbeb2a" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-1448318e-3076-41a9-9471-99478dfbeb2a" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Deleting offline snapshot 1448318e-3076-41a9-9471-99478dfbeb2a of volume e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:02:58 devstack sudo[119613]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] snapshot_file for this snap is: volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811" returned: 0 in 1.260s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fc5f69-a723-457f-ae4e-6b161ed3f297]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:58 devstack sudo[119658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e 1G Jun 20 00:02:58 devstack sudo[119658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:58 devstack sudo[119659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a Jun 20 00:02:58 devstack sudo[119659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ec081ee8-901a-46dc-acf6-6c9898d87b1d tempest-GroupSnapshotsTest-1521244586 None] Group tempest-GroupSnapshotsTest-Group-1471494640: creating Jun 20 00:02:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ec081ee8-901a-46dc-acf6-6c9898d87b1d tempest-GroupSnapshotsTest-1521244586 None] Group tempest-GroupSnapshotsTest-Group-1471494640: created successfully Jun 20 00:02:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ec081ee8-901a-46dc-acf6-6c9898d87b1d tempest-GroupSnapshotsTest-1521244586 None] Create group completed successfully. Jun 20 00:02:59 devstack sudo[119658]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e 1G" returned: 0 in 1.149s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:59 devstack sudo[119659]: pam_unix(sudo:session): session closed for user root Jun 20 00:02:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a" returned: 0 in 1.138s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:02:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:02:59 devstack sudo[119708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e Jun 20 00:02:59 devstack sudo[119708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:02:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5271a7b3-09c5-4a28-86c5-483e1fe3a976]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:02:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:02:59 devstack sudo[119713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 Jun 20 00:02:59 devstack sudo[119713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:00 devstack sudo[119708]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e" returned: 0 in 1.040s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:00 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e is being set with open permissions: ugo+rw Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:00 devstack sudo[119748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e Jun 20 00:03:00 devstack sudo[119748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:00 devstack sudo[119713]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Flow 'volume_create_manager' (d972e55b-a9b6-41ce-addf-b0d6a625b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3be93b-6f64-4190-a2c6-8915943d57d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4" returned: 0 in 1.104s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3be93b-6f64-4190-a2c6-8915943d57d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2125206283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd7f43e1-04b9-4f94-bebf-be92cf4ee46c,host='devstack@QuobyteHD#QuobyteHD',id=8f17eed2-c71c-4537-a200-cdaef39aced0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a46d2846bcb4f0393102595f5026602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:00Z,use_quota=True,user_id='9c7ccd0941af457cbbf9ba2fb6fdd4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce177ec4-7b09-46ef-a683-d6ee4bd86b73),volume_type_id=ce177ec4-7b09-46ef-a683-d6ee4bd86b73)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:00 devstack sudo[119756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a Jun 20 00:03:00 devstack sudo[119756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31293924-7616-4c73-a53a-56cde27e1a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31293924-7616-4c73-a53a-56cde27e1a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c346b6dc-7898-4f9b-bdec-0e25f2197c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c346b6dc-7898-4f9b-bdec-0e25f2197c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f17eed2-c71c-4537-a200-cdaef39aced0', 'volume_name': 'volume-8f17eed2-c71c-4537-a200-cdaef39aced0', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538c9347-65ef-4bf6-a78b-7a2a4b169981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538c9347-65ef-4bf6-a78b-7a2a4b169981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bab8d94-1769-470d-889d-9e1ccbd9de29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:00 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Volume 8f17eed2-c71c-4537-a200-cdaef39aced0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f17eed2-c71c-4537-a200-cdaef39aced0', 'volume_size': 1} Jun 20 00:03:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:01 devstack sudo[119748]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e" returned: 0 in 0.763s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:01 devstack sudo[119781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.info Jun 20 00:03:01 devstack sudo[119781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:01 devstack sudo[119756]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a" returned: 0 in 0.863s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:01 devstack sudo[119788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a Jun 20 00:03:01 devstack sudo[119788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:02 devstack sudo[119781]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.info" returned: 0 in 0.734s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:02 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.info is being set with open permissions: ugo+rw Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:02 devstack sudo[119809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.info Jun 20 00:03:02 devstack sudo[119809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:02 devstack sudo[119788]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4.1448318e-3076-41a9-9471-99478dfbeb2a" returned: 0 in 0.706s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-1448318e-3076-41a9-9471-99478dfbeb2a" released by "_delete_snapshot" :: held 3.984s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" released by "delete_snapshot" :: held 4.039s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Created reservations ['cbbdd121-104f-4e59-8f8d-e97016cb6e19', '4e293e16-5ddc-4dd0-ad5f-cd6e6ac61cff', '5dd72eee-84c5-4ae3-8f4c-74cc2274bd25', 'b67cc783-7caf-4bc2-a872-52abad86cc22'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Delete snapshot completed successfully. Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-1448318e-3076-41a9-9471-99478dfbeb2a-delete_snapshot" released by "delete_snapshot" :: held 4.238s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Snapshots deleted, issuing volume delete {{(pid=93391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb4232f-3eab-4c6c-86fb-b983dbf85fd6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:02 devstack sudo[119824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 Jun 20 00:03:02 devstack sudo[119824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:02 devstack sudo[119809]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.info" returned: 0 in 0.709s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.781s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd7f43e1-04b9-4f94-bebf-be92cf4ee46c,created_at=2026-06-19T22:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2125206283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd7f43e1-04b9-4f94-bebf-be92cf4ee46c,host='devstack@QuobyteHD#QuobyteHD',id=8f17eed2-c71c-4537-a200-cdaef39aced0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a46d2846bcb4f0393102595f5026602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:00Z,use_quota=True,user_id='9c7ccd0941af457cbbf9ba2fb6fdd4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce177ec4-7b09-46ef-a683-d6ee4bd86b73),volume_type_id=ce177ec4-7b09-46ef-a683-d6ee4bd86b73)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Creating volume 8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:02 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:03:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:02 devstack sudo[119836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 1073741824 Jun 20 00:03:02 devstack sudo[119836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ae4b3fbe-cd15-4a78-954f-1903eb40760b tempest-VolumesSnapshotTestJSON-1211356176 None] Create snapshot completed successfully Jun 20 00:03:03 devstack sudo[119824]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4" returned: 0 in 0.919s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:03 devstack sudo[119859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4 Jun 20 00:03:03 devstack sudo[119859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-1a028eb0-3246-4baa-b148-7d109f722e7e-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-1a028eb0-3246-4baa-b148-7d109f722e7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-9ee9b8fe-fe1a-44eb-8897-d675024e3811" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-9ee9b8fe-fe1a-44eb-8897-d675024e3811" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-1a028eb0-3246-4baa-b148-7d109f722e7e" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-1a028eb0-3246-4baa-b148-7d109f722e7e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Deleting offline snapshot 1a028eb0-3246-4baa-b148-7d109f722e7e of volume 9ee9b8fe-fe1a-44eb-8897-d675024e3811 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] snapshot_file for this snap is: volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f3fbc9-9d07-4676-998a-6fbba257f387]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:03 devstack sudo[119873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e Jun 20 00:03:03 devstack sudo[119873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:03 devstack sudo[119836]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 1073741824" returned: 0 in 1.154s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:04 devstack sudo[119884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 Jun 20 00:03:04 devstack sudo[119884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:04 devstack sudo[119859]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e174c004-ead9-4b9b-99af-0b324c1f1cd4" returned: 0 in 0.952s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-e174c004-ead9-4b9b-99af-0b324c1f1cd4" released by "delete_volume" :: held 1.958s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Created reservations ['7c31dc15-05c9-47a1-9045-ac786314b5c5', 'a82e55cc-f9e4-4d24-b835-711ef2f6e408', '1ce77aa2-61e3-4b48-be56-533ddc5e77a9', '0bdb1ac9-6ca3-4d98-879b-e40f0aa6a87d'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:04 devstack sudo[119908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:03:04 devstack sudo[119908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:04 devstack sudo[119873]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e" returned: 0 in 0.968s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b345340-20fa-4642-b0f8-3774fa5b24d0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:04 devstack sudo[119915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 Jun 20 00:03:04 devstack sudo[119915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:04 devstack sudo[119884]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0" returned: 0 in 0.975s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bab8d94-1769-470d-889d-9e1ccbd9de29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f17eed2-c71c-4537-a200-cdaef39aced0', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65873814-b234-4276-bd26-6e1e916e9b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:05 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Volume volume-8f17eed2-c71c-4537-a200-cdaef39aced0 (8f17eed2-c71c-4537-a200-cdaef39aced0): created successfully Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65873814-b234-4276-bd26-6e1e916e9b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Flow 'volume_create_manager' (d972e55b-a9b6-41ce-addf-b0d6a625b022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-4f4aa4ad-97ab-4ca5-9d3c-afa17d1cb4ee tempest-GroupSnapshotsTest-1521244586 None] Created volume successfully. Jun 20 00:03:05 devstack sudo[119908]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.262s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:03:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Deleted volume successfully. Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Flow 'volume_create_manager' (c31b475e-86bf-4c12-b53e-001865337818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39acdd25-1cc8-4212-b218-9ef6fe52c3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:05 devstack sudo[119915]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811" returned: 0 in 1.167s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c1b0203-e6fc-4ac0-afcf-2138919a793a tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-e174c004-ead9-4b9b-99af-0b324c1f1cd4-delete_volume" released by "delete_volume" :: held 13.251s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39acdd25-1cc8-4212-b218-9ef6fe52c3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-409348343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfc06c4-e138-4d08-b232-2387306c1fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec440a5da61b496c906d35f4e1aa2f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:06Z,use_quota=True,user_id='3ae90164cf4f4a36b02c264afca6c3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:05 devstack sudo[119957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2303f603-37e8-4807-8299-fd95d507aeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:05 devstack sudo[119957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2303f603-37e8-4807-8299-fd95d507aeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae25af51-5a52-4b79-8bac-372d5bff35a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae25af51-5a52-4b79-8bac-372d5bff35a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dfc06c4-e138-4d08-b232-2387306c1fbf', 'volume_name': 'volume-1dfc06c4-e138-4d08-b232-2387306c1fbf', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f845d1a2-1feb-4824-bcbd-95903c151388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f845d1a2-1feb-4824-bcbd-95903c151388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc94618-4f76-4992-a06c-847e49a92147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:05 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Volume 1dfc06c4-e138-4d08-b232-2387306c1fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dfc06c4-e138-4d08-b232-2387306c1fbf', 'volume_size': 1} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-409348343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dfc06c4-e138-4d08-b232-2387306c1fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec440a5da61b496c906d35f4e1aa2f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:06Z,use_quota=True,user_id='3ae90164cf4f4a36b02c264afca6c3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Creating volume 1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:05 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:03:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:05 devstack sudo[119962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf 1073741824 Jun 20 00:03:05 devstack sudo[119962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:06 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] GroupSnapshot 2f230c49-ed13-4338-ae8e-ca3905d0b51c: creating. Jun 20 00:03:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Group snapshot 2f230c49-ed13-4338-ae8e-ca3905d0b51c: creating. {{(pid=93391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 20 00:03:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:06 devstack sudo[119957]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e" returned: 0 in 0.929s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:06 devstack sudo[119995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e Jun 20 00:03:06 devstack sudo[119995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:07 devstack sudo[119962]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf 1073741824" returned: 0 in 1.067s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:07 devstack sudo[120006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf Jun 20 00:03:07 devstack sudo[120006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:07 devstack sudo[119995]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811.1a028eb0-3246-4baa-b148-7d109f722e7e" returned: 0 in 0.833s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-1a028eb0-3246-4baa-b148-7d109f722e7e" released by "_delete_snapshot" :: held 4.071s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-9ee9b8fe-fe1a-44eb-8897-d675024e3811" released by "delete_snapshot" :: held 4.103s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Created reservations ['839d7ac7-a224-48e0-bc79-5e94b13e3179', '987f21a3-b699-4d56-9269-4d963137f763', 'a405ee80-9c28-41e3-94d0-1a3a1e9737a3', '8c889979-2db6-4d6d-b663-351bc3d0da50'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Delete snapshot completed successfully. Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ded4fe13-e5a7-408a-9829-90a47260f08a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-1a028eb0-3246-4baa-b148-7d109f722e7e-delete_snapshot" released by "delete_snapshot" :: held 4.358s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:07 devstack sudo[120006]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf" returned: 0 in 0.898s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.894s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Creating offline snapshot afbc2140-42e1-4239-93a8-fe8d5db38930 of volume 8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:03:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc94618-4f76-4992-a06c-847e49a92147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dfc06c4-e138-4d08-b232-2387306c1fbf', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1daf4c48-5bb5-4644-8706-48f65a390a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:08 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f36c80-3a2d-4c0d-a9bd-b8b745c387bf]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:08 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Volume volume-1dfc06c4-e138-4d08-b232-2387306c1fbf (1dfc06c4-e138-4d08-b232-2387306c1fbf): created successfully Jun 20 00:03:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1daf4c48-5bb5-4644-8706-48f65a390a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Flow 'volume_create_manager' (c31b475e-86bf-4c12-b53e-001865337818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fb52245d-eaf0-49d3-baac-905cdf0b046c tempest-VolumesDeleteCascade-1060669598 None] Created volume successfully. Jun 20 00:03:08 devstack sudo[120039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 Jun 20 00:03:08 devstack sudo[120039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:09 devstack sudo[120039]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0" returned: 0 in 0.998s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:09 devstack sudo[120075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 1G Jun 20 00:03:09 devstack sudo[120075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (6a88e95f-4db4-4033-ba7e-8c6bb27a74c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e5074b-b8b8-4b52-8335-658b92b4e9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e5074b-b8b8-4b52-8335-658b92b4e9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371500107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4942cc32-9146-4224-bc55-b369c2eb5488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79014f628b8c464a82c5df6b1988f1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:10Z,use_quota=True,user_id='93589cee300c404faaa654226956c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb97201c-49ed-4620-b740-ed56cf25d5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb97201c-49ed-4620-b740-ed56cf25d5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aab02f-02f6-4b4f-88b7-e361a924f60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9aab02f-02f6-4b4f-88b7-e361a924f60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4942cc32-9146-4224-bc55-b369c2eb5488', 'volume_name': 'volume-4942cc32-9146-4224-bc55-b369c2eb5488', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2936b3b1-d1e6-403a-ba49-166397f74819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2936b3b1-d1e6-403a-ba49-166397f74819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c9ad05-c444-4530-868b-3f4780c6c8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:09 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume 4942cc32-9146-4224-bc55-b369c2eb5488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4942cc32-9146-4224-bc55-b369c2eb5488', 'volume_size': 1} Jun 20 00:03:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:10 devstack sudo[120075]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 1G" returned: 0 in 1.102s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f17eed2-c71c-4537-a200-cdaef39aced0 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:10 devstack sudo[120115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f17eed2-c71c-4537-a200-cdaef39aced0 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 Jun 20 00:03:10 devstack sudo[120115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:10 devstack sudo[120115]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f17eed2-c71c-4537-a200-cdaef39aced0 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930" returned: 0 in 0.808s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:10 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:03:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:10 devstack sudo[120145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 Jun 20 00:03:10 devstack sudo[120145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:11 devstack sudo[120145]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930" returned: 0 in 0.658s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:11 devstack sudo[120169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.info Jun 20 00:03:11 devstack sudo[120169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:12 devstack sudo[120169]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.info" returned: 0 in 0.649s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:12 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.info is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:03:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:12 devstack sudo[120194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.info Jun 20 00:03:12 devstack sudo[120194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:12 devstack sudo[120194]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.info" returned: 0 in 0.671s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.979s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.737s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Creating offline snapshot 9fa62357-1911-4f64-a9fc-35a109aa3e6f of volume 1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:03:13 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec7ec7a-3ee3-44d2-8968-23a12476a0d6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:13 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-862327cc-4f54-4f94-8fe8-8c77fec74803 tempest-GroupSnapshotsTest-1521244586 None] group_snapshot 2f230c49-ed13-4338-ae8e-ca3905d0b51c: created successfully Jun 20 00:03:13 devstack sudo[120219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf Jun 20 00:03:13 devstack sudo[120219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:13 devstack sudo[120219]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf" returned: 0 in 0.804s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:13 devstack sudo[120249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f 1G Jun 20 00:03:13 devstack sudo[120249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:14 devstack sudo[120249]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f 1G" returned: 0 in 0.914s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dfc06c4-e138-4d08-b232-2387306c1fbf -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:14 devstack sudo[120319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dfc06c4-e138-4d08-b232-2387306c1fbf -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f Jun 20 00:03:14 devstack sudo[120319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:15 devstack sudo[120319]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dfc06c4-e138-4d08-b232-2387306c1fbf -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f" returned: 0 in 0.781s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:15 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f is being set with open permissions: ugo+rw Jun 20 00:03:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:15 devstack sudo[120351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f Jun 20 00:03:15 devstack sudo[120351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:16 devstack sudo[120351]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f" returned: 0 in 0.690s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:16 devstack sudo[120375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.info Jun 20 00:03:16 devstack sudo[120375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:16 devstack sudo[120375]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.info" returned: 0 in 0.640s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:16 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.info is being set with open permissions: ugo+rw Jun 20 00:03:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:16 devstack sudo[120396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.info Jun 20 00:03:16 devstack sudo[120396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:17 devstack sudo[120396]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.info" returned: 0 in 0.658s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.586s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.857s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371500107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4942cc32-9146-4224-bc55-b369c2eb5488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79014f628b8c464a82c5df6b1988f1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:10Z,use_quota=True,user_id='93589cee300c404faaa654226956c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Creating volume 4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:17 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:03:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:17 devstack sudo[120420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 1073741824 Jun 20 00:03:17 devstack sudo[120420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-53b5ce7e-8729-4c75-9b22-64cb087d60b2 tempest-VolumesDeleteCascade-1060669598 None] Create snapshot completed successfully Jun 20 00:03:18 devstack sudo[120420]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 1073741824" returned: 0 in 0.818s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:18 devstack sudo[120451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 Jun 20 00:03:18 devstack sudo[120451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:19 devstack sudo[120451]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488" returned: 0 in 0.663s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.447s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-afbc2140-42e1-4239-93a8-fe8d5db38930-24ce0916-8158-4ec3-bef0-dc937f3c3d00" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08c9ad05-c444-4530-868b-3f4780c6c8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4942cc32-9146-4224-bc55-b369c2eb5488', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d197611-0b82-44a7-ad38-2e147cccf914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-afbc2140-42e1-4239-93a8-fe8d5db38930-24ce0916-8158-4ec3-bef0-dc937f3c3d00" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Creating volume 24ce0916-8158-4ec3-bef0-dc937f3c3d00 from snapshot afbc2140-42e1-4239-93a8-fe8d5db38930 {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-24ce0916-8158-4ec3-bef0-dc937f3c3d00" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:19 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume volume-4942cc32-9146-4224-bc55-b369c2eb5488 (4942cc32-9146-4224-bc55-b369c2eb5488): created successfully Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d197611-0b82-44a7-ad38-2e147cccf914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (6a88e95f-4db4-4033-ba7e-8c6bb27a74c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-24ce0916-8158-4ec3-bef0-dc937f3c3d00" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] snapshot: afbc2140-42e1-4239-93a8-fe8d5db38930, volume: 24ce0916-8158-4ec3-bef0-dc937f3c3d00, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:03:19 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-27ff82bb-dd5f-4e84-a8de-b375cbdf9df7 tempest-VolumesSnapshotTestJSON-1211356176 None] Created volume successfully. Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Flow 'volume_create_manager' (7493fe82-f2f9-4dd2-bf47-52690238680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c562a4-32f6-47b1-9fd0-57d22146a6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a34e9f2-16be-40fb-a401-bee36d9b777a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c562a4-32f6-47b1-9fd0-57d22146a6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-876780549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b55c3b-235c-4db3-a0fe-e3d4727d2dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec440a5da61b496c906d35f4e1aa2f0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9fa62357-1911-4f64-a9fc-35a109aa3e6f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:19Z,use_quota=True,user_id='3ae90164cf4f4a36b02c264afca6c3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cee6a5-7ca3-4fe3-b411-7305ce3147ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cee6a5-7ca3-4fe3-b411-7305ce3147ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f384214a-85a8-46a3-8a3b-99a88e6acc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f384214a-85a8-46a3-8a3b-99a88e6acc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7b55c3b-235c-4db3-a0fe-e3d4727d2dce', 'volume_name': 'volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce', 'volume_size': 1, 'snapshot_id': '9fa62357-1911-4f64-a9fc-35a109aa3e6f'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c15e916-4ac3-40b1-a10b-5ea0ba4cbf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c15e916-4ac3-40b1-a10b-5ea0ba4cbf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bad007-75d1-4475-9a96-d16747878749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:19 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Volume d7b55c3b-235c-4db3-a0fe-e3d4727d2dce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce', 'volume_size': 1, 'snapshot_id': '9fa62357-1911-4f64-a9fc-35a109aa3e6f'} Jun 20 00:03:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:19 devstack sudo[120480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 Jun 20 00:03:19 devstack sudo[120480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:20 devstack sudo[120480]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930" returned: 0 in 0.845s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f17eed2-c71c-4537-a200-cdaef39aced0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:03:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:03:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:03:20 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80ca5e8-1d65-4940-a298-403df7b763ef]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:20 devstack sudo[120512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 Jun 20 00:03:20 devstack sudo[120512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:21 devstack sudo[120512]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0" returned: 0 in 0.937s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:21 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:03:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:21 devstack sudo[120544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 Jun 20 00:03:21 devstack sudo[120544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:26 devstack sudo[120544]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00" returned: 0 in 5.776s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:26 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7f24ab-6cdd-40e1-b6db-a834b7fbfe9c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:27 devstack sudo[120761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 Jun 20 00:03:27 devstack sudo[120761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:27 devstack sudo[120761]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0" returned: 0 in 0.982s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:27 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:03:27 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Converted 1024.00 MB image at 177.24 MB/s Jun 20 00:03:27 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:03:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:27 devstack sudo[120826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 Jun 20 00:03:27 devstack sudo[120826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:28 devstack sudo[120838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:03:28 devstack sudo[120838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:28 devstack sudo[120826]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00" returned: 0 in 1.042s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-24ce0916-8158-4ec3-bef0-dc937f3c3d00" released by "_copy_volume_from_snapshot" :: held 9.779s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-afbc2140-42e1-4239-93a8-fe8d5db38930-24ce0916-8158-4ec3-bef0-dc937f3c3d00" released by "_create_volume_from_snapshot" :: held 9.838s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.894s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.599s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-9fa62357-1911-4f64-a9fc-35a109aa3e6f-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-9fa62357-1911-4f64-a9fc-35a109aa3e6f-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Creating volume d7b55c3b-235c-4db3-a0fe-e3d4727d2dce from snapshot 9fa62357-1911-4f64-a9fc-35a109aa3e6f {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] snapshot: 9fa62357-1911-4f64-a9fc-35a109aa3e6f, volume: d7b55c3b-235c-4db3-a0fe-e3d4727d2dce, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcfaba9-0d98-4554-9ea8-da4adad936a2]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:29 devstack sudo[120838]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.245s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:03:29 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c243608c-3d64-4109-bf1d-2daa2ae719b5 tempest-GroupSnapshotsTest-1521244586 None] Create group from source-snapshot-2f230c49-ed13-4338-ae8e-ca3905d0b51c completed successfully. Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:03:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:03:29 devstack sudo[120920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f Jun 20 00:03:29 devstack sudo[120920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:30 devstack sudo[120920]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f" returned: 0 in 0.945s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dfc06c4-e138-4d08-b232-2387306c1fbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ce2eec-086c-4d3e-91b2-1ff3cd10262b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-24ce0916-8158-4ec3-bef0-dc937f3c3d00" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-24ce0916-8158-4ec3-bef0-dc937f3c3d00" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c1f87-648b-45d9-8b1b-f48231753c9d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:30 devstack sudo[120959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf Jun 20 00:03:30 devstack sudo[120959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:30 devstack sudo[120964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 Jun 20 00:03:30 devstack sudo[120964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:31 devstack sudo[120959]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf" returned: 0 in 1.023s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:31 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:03:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:31 devstack sudo[120999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce Jun 20 00:03:31 devstack sudo[120999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:31 devstack sudo[120964]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00" returned: 0 in 1.029s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:31 devstack sudo[121004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00 Jun 20 00:03:31 devstack sudo[121004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:32 devstack sudo[121004]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-24ce0916-8158-4ec3-bef0-dc937f3c3d00" returned: 0 in 0.787s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-24ce0916-8158-4ec3-bef0-dc937f3c3d00" released by "delete_volume" :: held 1.896s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['03771642-d0b6-4402-8170-2bdef4e1cdc5'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:32 devstack cinder-volume[93391]: WARNING cinder.quota [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-968745018 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-968745018, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:03:32 devstack cinder-volume[93391]: WARNING cinder.quota [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-968745018 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-968745018, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['9e52b755-089f-48b3-913f-42735b37c056', 'e9198082-55ce-48e4-9194-9476f3bfa1f8', '909d46a5-ad2a-470b-8deb-8cad75781fb7', '11879b29-81e6-416b-968f-b87305088358'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:32 devstack sudo[121062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:03:32 devstack sudo[121062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] group_snapshot 2f230c49-ed13-4338-ae8e-ca3905d0b51c: deleting Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] group_snapshot 2f230c49-ed13-4338-ae8e-ca3905d0b51c: deleting {{(pid=93391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 20 00:03:34 devstack sudo[121062]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.624s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:03:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-44e02713-7861-4b4e-bfea-49effa68f16e tempest-GroupSnapshotsTest-1521244586 None] Delete group completed successfully. Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-8f17eed2-c71c-4537-a200-cdaef39aced0" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-8f17eed2-c71c-4537-a200-cdaef39aced0" acquired by "delete_snapshot" :: waited 0.063s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-afbc2140-42e1-4239-93a8-fe8d5db38930" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-afbc2140-42e1-4239-93a8-fe8d5db38930" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Deleting offline snapshot afbc2140-42e1-4239-93a8-fe8d5db38930 of volume 8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] snapshot_file for this snap is: volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d856f34-77d5-4ed9-a0bc-fbdef7b3f2e5]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:35 devstack sudo[121125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 Jun 20 00:03:35 devstack sudo[121125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:35 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Flow 'volume_create_manager' (de4dff46-fe74-4d09-b79b-5e420d283191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3a3d46-af87-4478-816e-fe152041f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3a3d46-af87-4478-816e-fe152041f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-307049733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b94ce60-0ec7-45bc-9795-5ed9b646f4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a6c680cd934b5e9fd4109134fe2121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:36Z,use_quota=True,user_id='73ecb4563a2d4ebbb29667a3df3dbcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98eaa14-f12a-40ca-8ea3-3fe2c57cd805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98eaa14-f12a-40ca-8ea3-3fe2c57cd805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0394ad4a-8fc8-49f8-ab06-24f4f309fbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0394ad4a-8fc8-49f8-ab06-24f4f309fbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b94ce60-0ec7-45bc-9795-5ed9b646f4ff', 'volume_name': 'volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c447229-5366-4b8e-842d-7a4c6efc79ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c447229-5366-4b8e-842d-7a4c6efc79ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3164f943-8819-49ff-9a20-715d86869308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Volume 9b94ce60-0ec7-45bc-9795-5ed9b646f4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff', 'volume_size': 1} Jun 20 00:03:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:37 devstack sudo[121125]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930" returned: 0 in 2.877s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f17eed2-c71c-4537-a200-cdaef39aced0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:03:37 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc742e14-9a2c-4c49-b4bc-6d2ed5d4aba4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:38 devstack sudo[121218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 Jun 20 00:03:38 devstack sudo[121218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:38 devstack sudo[120999]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" returned: 0 in 7.522s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:38 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e95e9a8-ca3b-43e8-b8e4-50ad5946b573]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:38 devstack sudo[121247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf Jun 20 00:03:38 devstack sudo[121247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:39 devstack sudo[121218]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0" returned: 0 in 1.453s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:39 devstack sudo[121267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 Jun 20 00:03:39 devstack sudo[121267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:39 devstack sudo[121247]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf" returned: 0 in 1.021s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:39 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf, size 1024.00 MB, duration 7.52 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:03:39 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Converted 1024.00 MB image at 136.10 MB/s Jun 20 00:03:39 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce is being set with open permissions: ugo+rw Jun 20 00:03:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:39 devstack sudo[121287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce Jun 20 00:03:39 devstack sudo[121287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:40 devstack sudo[121267]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930" returned: 0 in 0.827s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:40 devstack sudo[121306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930 Jun 20 00:03:40 devstack sudo[121306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:40 devstack sudo[121287]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" returned: 0 in 0.697s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" released by "_copy_volume_from_snapshot" :: held 11.406s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-9fa62357-1911-4f64-a9fc-35a109aa3e6f-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" released by "_create_volume_from_snapshot" :: held 11.502s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.530s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 20.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Creating offline snapshot 431331d9-5980-4e63-9418-0aca51d0bd72 of volume 4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bad007-75d1-4475-9a96-d16747878749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce', 'volume_size': 1, 'snapshot_id': '9fa62357-1911-4f64-a9fc-35a109aa3e6f'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110f37cc-7eda-402f-acc0-54ebca3cb3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a50d21-2318-4c73-b18b-4b06da331945]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:40 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Volume volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce (d7b55c3b-235c-4db3-a0fe-e3d4727d2dce): created successfully Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110f37cc-7eda-402f-acc0-54ebca3cb3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Flow 'volume_create_manager' (7493fe82-f2f9-4dd2-bf47-52690238680a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fa1948b6-7b16-41b5-b84f-664da2b1e6d3 tempest-VolumesDeleteCascade-1060669598 None] Created volume successfully. Jun 20 00:03:40 devstack sudo[121321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 Jun 20 00:03:40 devstack sudo[121321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:40 devstack sudo[121306]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0.afbc2140-42e1-4239-93a8-fe8d5db38930" returned: 0 in 0.684s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-afbc2140-42e1-4239-93a8-fe8d5db38930" released by "_delete_snapshot" :: held 6.175s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-8f17eed2-c71c-4537-a200-cdaef39aced0" released by "delete_snapshot" :: held 6.249s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=66,cinder:DELETE=5,cinder:SELECT=70,cinder:INSERT=15 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=81,cinder:UPDATE=59,cinder:DELETE=6,cinder:INSERT=14 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:03:40 devstack cinder-volume[93391]: WARNING cinder.quota [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-968745018 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-968745018, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:03:40 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['9afe71f4-5a94-4416-ac2c-daf89bca32b2', '7507a717-6206-4288-b8fe-8afb6c8ec424', 'be7891a6-d6c1-436c-8dc6-d8afcaa8d888', '8fa8ae15-4f09-475c-99d0-3e036e374fb8'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:41 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e55b1fcf-4268-41e4-8ade-27f4482b8460 tempest-GroupSnapshotsTest-1521244586 None] group_snapshot 2f230c49-ed13-4338-ae8e-ca3905d0b51c: deleted successfully Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-1dfc06c4-e138-4d08-b232-2387306c1fbf-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-1dfc06c4-e138-4d08-b232-2387306c1fbf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Performing cascade delete. {{(pid=93391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-9fa62357-1911-4f64-a9fc-35a109aa3e6f-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-9fa62357-1911-4f64-a9fc-35a109aa3e6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-1dfc06c4-e138-4d08-b232-2387306c1fbf" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-1dfc06c4-e138-4d08-b232-2387306c1fbf" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-9fa62357-1911-4f64-a9fc-35a109aa3e6f" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-9fa62357-1911-4f64-a9fc-35a109aa3e6f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Deleting offline snapshot 9fa62357-1911-4f64-a9fc-35a109aa3e6f of volume 1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] snapshot_file for this snap is: volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd89c886-4bad-421f-9c2f-ccc523e9c7a9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:41 devstack sudo[121321]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488" returned: 0 in 1.016s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:41 devstack sudo[121359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 1G Jun 20 00:03:41 devstack sudo[121359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-8f17eed2-c71c-4537-a200-cdaef39aced0" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-8f17eed2-c71c-4537-a200-cdaef39aced0" acquired by "delete_volume" :: waited 0.044s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:41 devstack sudo[121358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f Jun 20 00:03:41 devstack sudo[121358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ce8faf-2336-4c4c-8366-b433e83e9015]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:42 devstack sudo[121368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 Jun 20 00:03:42 devstack sudo[121368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:42 devstack sudo[121359]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 1G" returned: 0 in 1.047s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:42 devstack sudo[121358]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4942cc32-9146-4224-bc55-b369c2eb5488 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f" returned: 0 in 1.100s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dfc06c4-e138-4d08-b232-2387306c1fbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:03:42 devstack sudo[121404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4942cc32-9146-4224-bc55-b369c2eb5488 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 Jun 20 00:03:42 devstack sudo[121404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:42 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c5a4e-592d-4306-848f-d5f873553d75]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:42 devstack sudo[121368]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0" returned: 0 in 1.058s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:42 devstack sudo[121408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf Jun 20 00:03:42 devstack sudo[121408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:42 devstack sudo[121423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0 Jun 20 00:03:42 devstack sudo[121423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:43 devstack sudo[121404]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4942cc32-9146-4224-bc55-b369c2eb5488 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72" returned: 0 in 0.832s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:43 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 is being set with open permissions: ugo+rw Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:43 devstack sudo[121461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 Jun 20 00:03:43 devstack sudo[121461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:43 devstack sudo[121408]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf" returned: 0 in 1.009s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:43 devstack sudo[121473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f Jun 20 00:03:43 devstack sudo[121473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:43 devstack sudo[121423]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f17eed2-c71c-4537-a200-cdaef39aced0" returned: 0 in 0.893s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-8f17eed2-c71c-4537-a200-cdaef39aced0" released by "delete_volume" :: held 2.052s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['2188a186-d49c-43a6-b2bf-3023ec88daf0'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:43 devstack cinder-volume[93391]: WARNING cinder.db.api [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-968745018'] Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['11201b16-1da8-4b0f-8c0e-d0e6f5694c90', '26b852d5-ccfe-4ab8-9395-1388d84bc460', 'ce0962fd-ede2-4874-a384-60668203056a', '784f9d43-e8cf-4993-985d-ae2844c1615b'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:44 devstack sudo[121484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:03:44 devstack sudo[121484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:44 devstack sudo[121461]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72" returned: 0 in 0.712s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:44 devstack sudo[121493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.info Jun 20 00:03:44 devstack sudo[121493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:44 devstack sudo[121473]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f" returned: 0 in 0.890s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:44 devstack sudo[121511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f Jun 20 00:03:44 devstack sudo[121511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2bf2d339-c52e-4d10-ada6-2989b020e56d tempest-GroupSnapshotsTest-1521244586 None] Group tempest-GroupSnapshotsTest-Group-1601537001: creating Jun 20 00:03:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2bf2d339-c52e-4d10-ada6-2989b020e56d tempest-GroupSnapshotsTest-1521244586 None] Group tempest-GroupSnapshotsTest-Group-1601537001: created successfully Jun 20 00:03:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2bf2d339-c52e-4d10-ada6-2989b020e56d tempest-GroupSnapshotsTest-1521244586 None] Create group completed successfully. Jun 20 00:03:44 devstack sudo[121484]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.837s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:44 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:03:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d61d3046-609f-4a67-a581-e2f2a443eec9 tempest-GroupSnapshotsTest-1521244586 None] Delete group completed successfully. Jun 20 00:03:45 devstack sudo[121493]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.info" returned: 0 in 0.809s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:45 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.info is being set with open permissions: ugo+rw Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:45 devstack sudo[121528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.info Jun 20 00:03:45 devstack sudo[121528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:45 devstack sudo[121511]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf.9fa62357-1911-4f64-a9fc-35a109aa3e6f" returned: 0 in 0.717s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-9fa62357-1911-4f64-a9fc-35a109aa3e6f" released by "_delete_snapshot" :: held 3.834s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-1dfc06c4-e138-4d08-b232-2387306c1fbf" released by "delete_snapshot" :: held 3.867s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Created reservations ['8896cd50-9d71-4b69-b218-633ca310dbd6', 'd06900c9-d968-42a4-b075-6febdd05aa29', '1894747b-fd51-47ac-8f5a-612a20db13da', 'd40a4e2e-aad8-42e5-bc8e-f4e7f7629cd4'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:45 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Delete snapshot completed successfully. Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-9fa62357-1911-4f64-a9fc-35a109aa3e6f-delete_snapshot" released by "delete_snapshot" :: held 4.036s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Snapshots deleted, issuing volume delete {{(pid=93391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-1dfc06c4-e138-4d08-b232-2387306c1fbf" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-1dfc06c4-e138-4d08-b232-2387306c1fbf" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[598d39d1-f7f4-46e9-9954-925b1297a110]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:45 devstack sudo[121546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf Jun 20 00:03:45 devstack sudo[121546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:45 devstack sudo[121528]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.info" returned: 0 in 0.670s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.219s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.564s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-307049733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b94ce60-0ec7-45bc-9795-5ed9b646f4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a6c680cd934b5e9fd4109134fe2121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:36Z,use_quota=True,user_id='73ecb4563a2d4ebbb29667a3df3dbcce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Creating volume 9b94ce60-0ec7-45bc-9795-5ed9b646f4ff {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:45 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:03:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:45 devstack sudo[121555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff 1073741824 Jun 20 00:03:45 devstack sudo[121555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:45 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-60f19428-b9f4-4f41-b3e7-63390bfabb0d tempest-VolumesSnapshotTestJSON-1211356176 None] Create snapshot completed successfully Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Flow 'volume_create_manager' (c58e8ae4-48e1-4a97-8cda-153d28443d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:46 devstack sudo[121546]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa34d42-56be-4c17-b06b-8536cbb7e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf" returned: 0 in 0.994s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aa34d42-56be-4c17-b06b-8536cbb7e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1397933110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43165d61-d188-49e5-8087-e9d809659ca4,host='devstack@QuobyteHD#QuobyteHD',id=3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a46d2846bcb4f0393102595f5026602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:46Z,use_quota=True,user_id='9c7ccd0941af457cbbf9ba2fb6fdd4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfd661a5-5aa6-4c1c-aa29-feaf82c2ee35),volume_type_id=dfd661a5-5aa6-4c1c-aa29-feaf82c2ee35)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:46 devstack sudo[121587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcdb879-26fa-417f-bf4f-92c16c25832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:46 devstack sudo[121587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcdb879-26fa-417f-bf4f-92c16c25832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f00657a-c6fa-47d7-9bc3-c416a6934010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f00657a-c6fa-47d7-9bc3-c416a6934010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc', 'volume_name': 'volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe952d45-cb42-4092-a121-f8da8ae5ad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe952d45-cb42-4092-a121-f8da8ae5ad6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d218221-10ef-47ac-a70e-5112b3a00ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:46 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Volume 3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc', 'volume_size': 1} Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:46 devstack sudo[121555]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff 1073741824" returned: 0 in 1.205s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:47 devstack sudo[121605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff Jun 20 00:03:47 devstack sudo[121605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (e2622499-9313-447e-952f-9a25c6f9d773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae865bd-6953-4815-9d35-3ceacbf65e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae865bd-6953-4815-9d35-3ceacbf65e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1594411463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95127945-0873-4c97-a13a-f29dec29ea8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79014f628b8c464a82c5df6b1988f1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=431331d9-5980-4e63-9418-0aca51d0bd72,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:47Z,use_quota=True,user_id='93589cee300c404faaa654226956c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15aa8639-9ec9-41f9-88f7-8ec968f18e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15aa8639-9ec9-41f9-88f7-8ec968f18e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40afa6f4-f87f-49ba-8f6d-4ae90def6358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:47 devstack sudo[121587]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40afa6f4-f87f-49ba-8f6d-4ae90def6358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '95127945-0873-4c97-a13a-f29dec29ea8e', 'volume_name': 'volume-95127945-0873-4c97-a13a-f29dec29ea8e', 'volume_size': 2, 'snapshot_id': '431331d9-5980-4e63-9418-0aca51d0bd72'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3db060d-f189-4ab5-b46c-e2dbe8e1fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3db060d-f189-4ab5-b46c-e2dbe8e1fe20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9d593d-8916-4b80-9b61-7e32458b5dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:47 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Volume 95127945-0873-4c97-a13a-f29dec29ea8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-95127945-0873-4c97-a13a-f29dec29ea8e', 'volume_size': 2, 'snapshot_id': '431331d9-5980-4e63-9418-0aca51d0bd72'} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1dfc06c4-e138-4d08-b232-2387306c1fbf" returned: 0 in 0.924s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-1dfc06c4-e138-4d08-b232-2387306c1fbf" released by "delete_volume" :: held 1.977s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Created reservations ['c9d497e9-0d5d-4084-8051-5f226831e82e', '30716275-747e-49fc-9686-662b63a93042', 'ddabdc9a-ca06-4bca-8856-c43f924699ac', '7a9b1bb4-a506-443a-824b-c6b3aa3e425f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:47 devstack sudo[121626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:03:47 devstack sudo[121626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:47 devstack sudo[121605]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff" returned: 0 in 0.873s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43165d61-d188-49e5-8087-e9d809659ca4,created_at=2026-06-19T22:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1397933110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43165d61-d188-49e5-8087-e9d809659ca4,host='devstack@QuobyteHD#QuobyteHD',id=3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a46d2846bcb4f0393102595f5026602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:46Z,use_quota=True,user_id='9c7ccd0941af457cbbf9ba2fb6fdd4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfd661a5-5aa6-4c1c-aa29-feaf82c2ee35),volume_type_id=dfd661a5-5aa6-4c1c-aa29-feaf82c2ee35)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Creating volume 3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:47 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3164f943-8819-49ff-9a20-715d86869308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:47 devstack sudo[121638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc 1073741824 Jun 20 00:03:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13c733b-8bda-400c-90d1-7f58092c27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:47 devstack sudo[121638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:48 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Volume volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff (9b94ce60-0ec7-45bc-9795-5ed9b646f4ff): created successfully Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13c733b-8bda-400c-90d1-7f58092c27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Flow 'volume_create_manager' (de4dff46-fe74-4d09-b79b-5e420d283191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:48 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0eef2278-ed46-4897-8818-e137acf2dc90 tempest-TestMinimumBasicScenario-1501891981 None] Created volume successfully. Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "cinder-quobyte-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e4d10-86cb-4b90-8a01-43f4db0cb677]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:48 devstack sudo[121651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce Jun 20 00:03:48 devstack sudo[121651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:48 devstack sudo[121626]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.845s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:03:48 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Deleted volume successfully. Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf3fb279-d673-470c-8dcb-e1af17351b01 tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-1dfc06c4-e138-4d08-b232-2387306c1fbf-delete_volume" released by "delete_volume" :: held 7.243s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:48 devstack sudo[121638]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc 1073741824" returned: 0 in 0.970s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:48 devstack sudo[121678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc Jun 20 00:03:48 devstack sudo[121678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:49 devstack sudo[121651]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" returned: 0 in 0.896s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:49 devstack sudo[121690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce Jun 20 00:03:49 devstack sudo[121690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:49 devstack sudo[121678]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" returned: 0 in 0.817s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.308s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-431331d9-5980-4e63-9418-0aca51d0bd72-95127945-0873-4c97-a13a-f29dec29ea8e" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d218221-10ef-47ac-a70e-5112b3a00ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e3fb2-4b05-4ecd-b76d-02461be37ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-431331d9-5980-4e63-9418-0aca51d0bd72-95127945-0873-4c97-a13a-f29dec29ea8e" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Creating volume 95127945-0873-4c97-a13a-f29dec29ea8e from snapshot 431331d9-5980-4e63-9418-0aca51d0bd72 {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-95127945-0873-4c97-a13a-f29dec29ea8e" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:03:49 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Volume volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc (3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc): created successfully Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e3fb2-4b05-4ecd-b76d-02461be37ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Flow 'volume_create_manager' (c58e8ae4-48e1-4a97-8cda-153d28443d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-95127945-0873-4c97-a13a-f29dec29ea8e" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] snapshot: 431331d9-5980-4e63-9418-0aca51d0bd72, volume: 95127945-0873-4c97-a13a-f29dec29ea8e, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:03:49 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1d5db136-6926-4424-ae0e-6df909c3a578 tempest-GroupSnapshotsTest-1521244586 None] Created volume successfully. Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11594e32-318b-4cfb-bbe2-ff7475571106]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:50 devstack sudo[121690]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" returned: 0 in 0.840s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:50 devstack sudo[121718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 Jun 20 00:03:50 devstack sudo[121718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-quobyte-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce" released by "delete_volume" :: held 1.802s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Created reservations ['b585801a-1685-4df6-b064-c0bf6ed134ab', '823215f3-bf74-4147-b084-82f5c2607d74', '3c3bbd94-d314-4f8f-add8-3c070c5f2203', 'e3b948ee-948e-4ab2-a58e-d2c9e66607a9'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:50 devstack sudo[121729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:03:50 devstack sudo[121729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:51 devstack sudo[121718]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72" returned: 0 in 1.149s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4942cc32-9146-4224-bc55-b369c2eb5488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6f63f-2cc9-415e-acfc-e9bf5a2606e2]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Flow 'volume_create_manager' (2f33a055-107e-4f6a-b8d0-5f1428d144c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9778adb2-c034-42d2-a3b7-2f5369cfc341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9778adb2-c034-42d2-a3b7-2f5369cfc341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-887510163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43165d61-d188-49e5-8087-e9d809659ca4,host='devstack@QuobyteHD#QuobyteHD',id=b85976d8-5568-49d8-b84a-29d873248303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a46d2846bcb4f0393102595f5026602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:51Z,use_quota=True,user_id='9c7ccd0941af457cbbf9ba2fb6fdd4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfd661a5-5aa6-4c1c-aa29-feaf82c2ee35),volume_type_id=dfd661a5-5aa6-4c1c-aa29-feaf82c2ee35)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cf8c17-da65-46f2-a1cc-ae298e255954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cf8c17-da65-46f2-a1cc-ae298e255954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e221d4e1-3dc4-409e-90f5-c20fbb450ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e221d4e1-3dc4-409e-90f5-c20fbb450ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85976d8-5568-49d8-b84a-29d873248303', 'volume_name': 'volume-b85976d8-5568-49d8-b84a-29d873248303', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabca237-9ee2-4485-af01-599d7e2eb8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabca237-9ee2-4485-af01-599d7e2eb8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:51 devstack sudo[121763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 Jun 20 00:03:51 devstack sudo[121763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83b7722-7e86-4a88-80ca-03f65bbdbbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:51 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Volume b85976d8-5568-49d8-b84a-29d873248303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85976d8-5568-49d8-b84a-29d873248303', 'volume_size': 1} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:51 devstack sudo[121729]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.061s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:03:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Deleted volume successfully. Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-df4c78d8-943d-4785-9ceb-de3be8fe85fd tempest-VolumesDeleteCascade-1060669598 None] Lock "cinder-d7b55c3b-235c-4db3-a0fe-e3d4727d2dce-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:51 devstack sudo[121763]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488" returned: 0 in 0.864s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:03:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:51 devstack sudo[121796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e Jun 20 00:03:51 devstack sudo[121796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-a3ca22bb-908e-43f1-ad19-9a87daa7482e req-f5c405de-f199-4332-bd8f-acc33a4c74a7 tempest-TestMinimumBasicScenario-1501891981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:57 devstack sudo[121796]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e" returned: 0 in 5.469s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:57 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb12824-9770-4332-9f6c-4d62c9313c40]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:03:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:57 devstack sudo[121980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 Jun 20 00:03:57 devstack sudo[121980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:03:58 devstack sudo[121980]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Flow 'volume_create_manager' (ba5e69bc-af6d-4219-8434-6083114d3e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0144f29a-c0ec-4bbc-9184-33bb1dec5af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488" returned: 0 in 1.008s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:03:58 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Converted 1024.00 MB image at 187.19 MB/s Jun 20 00:03:58 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e is being set with open permissions: ugo+rw Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0144f29a-c0ec-4bbc-9184-33bb1dec5af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1654666343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba59a5ab-b7f0-435a-a124-74dc1fbd3109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='987c700af00941fc81e14e20e35b05e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:58Z,use_quota=True,user_id='395620c579d9434984ac31580f5053ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:58 devstack sudo[122015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e Jun 20 00:03:58 devstack sudo[122015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73191419-7683-45da-89c5-2fa1664fbe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73191419-7683-45da-89c5-2fa1664fbe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cbc51d-626e-488e-baca-db095229bf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cbc51d-626e-488e-baca-db095229bf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba59a5ab-b7f0-435a-a124-74dc1fbd3109', 'volume_name': 'volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6c2fd7-ffee-4cb3-8ba6-e7d3db73011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6c2fd7-ffee-4cb3-8ba6-e7d3db73011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d074a7-0872-4cac-95f6-a2b0861c2ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:58 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Volume ba59a5ab-b7f0-435a-a124-74dc1fbd3109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109', 'volume_size': 1} Jun 20 00:03:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:59 devstack sudo[122015]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e" returned: 0 in 0.647s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-95127945-0873-4c97-a13a-f29dec29ea8e" released by "_copy_volume_from_snapshot" :: held 9.253s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-431331d9-5980-4e63-9418-0aca51d0bd72-95127945-0873-4c97-a13a-f29dec29ea8e" released by "_create_volume_from_snapshot" :: held 9.306s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.353s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.918s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43165d61-d188-49e5-8087-e9d809659ca4,created_at=2026-06-19T22:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-887510163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43165d61-d188-49e5-8087-e9d809659ca4,host='devstack@QuobyteHD#QuobyteHD',id=b85976d8-5568-49d8-b84a-29d873248303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a46d2846bcb4f0393102595f5026602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:51Z,use_quota=True,user_id='9c7ccd0941af457cbbf9ba2fb6fdd4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfd661a5-5aa6-4c1c-aa29-feaf82c2ee35),volume_type_id=dfd661a5-5aa6-4c1c-aa29-feaf82c2ee35)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Creating volume b85976d8-5568-49d8-b84a-29d873248303 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:03:59 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:03:59 devstack sudo[122044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 1073741824 Jun 20 00:03:59 devstack sudo[122044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9d593d-8916-4b80-9b61-7e32458b5dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95127945-0873-4c97-a13a-f29dec29ea8e', 'volume_size': 2, 'snapshot_id': '431331d9-5980-4e63-9418-0aca51d0bd72'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07261e5e-7b1f-4a26-81e7-a14e8b17a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:03:59 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Volume volume-95127945-0873-4c97-a13a-f29dec29ea8e (95127945-0873-4c97-a13a-f29dec29ea8e): created successfully Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07261e5e-7b1f-4a26-81e7-a14e8b17a903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (e2622499-9313-447e-952f-9a25c6f9d773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:03:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0e093cdc-9b15-46eb-a0b9-25cbfdf0584d tempest-VolumesSnapshotTestJSON-1211356176 None] Created volume successfully. Jun 20 00:03:59 devstack sudo[122044]: pam_unix(sudo:session): session closed for user root Jun 20 00:03:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 1073741824" returned: 0 in 0.837s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-95127945-0873-4c97-a13a-f29dec29ea8e-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-95127945-0873-4c97-a13a-f29dec29ea8e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:00 devstack sudo[122074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 Jun 20 00:04:00 devstack sudo[122074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-95127945-0873-4c97-a13a-f29dec29ea8e" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-95127945-0873-4c97-a13a-f29dec29ea8e" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[673ebfbf-1c33-4dff-a3da-272da5afc8e5]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:00 devstack sudo[122079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e Jun 20 00:04:00 devstack sudo[122079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:00 devstack sudo[122074]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303" returned: 0 in 0.665s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-a3ca22bb-908e-43f1-ad19-9a87daa7482e req-f5c405de-f199-4332-bd8f-acc33a4c74a7 tempest-TestMinimumBasicScenario-1501891981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.062s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83b7722-7e86-4a88-80ca-03f65bbdbbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85976d8-5568-49d8-b84a-29d873248303', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84a6b7e-2fce-484e-8efa-423719bc161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c95b6f-4c2d-4ad7-b721-8f84a35b60d6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-a3ca22bb-908e-43f1-ad19-9a87daa7482e req-f5c405de-f199-4332-bd8f-acc33a4c74a7 tempest-TestMinimumBasicScenario-1501891981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:00 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Volume volume-b85976d8-5568-49d8-b84a-29d873248303 (b85976d8-5568-49d8-b84a-29d873248303): created successfully Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84a6b7e-2fce-484e-8efa-423719bc161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Flow 'volume_create_manager' (2f33a055-107e-4f6a-b8d0-5f1428d144c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:00 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b7f7d3a3-8ca2-4dff-bb2e-d5ce2a298c7c tempest-GroupSnapshotsTest-1521244586 None] Created volume successfully. Jun 20 00:04:00 devstack sudo[122100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff Jun 20 00:04:00 devstack sudo[122100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:00 devstack sudo[122079]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e" returned: 0 in 0.785s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:00 devstack sudo[122111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e Jun 20 00:04:00 devstack sudo[122111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:01 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-328c7ec1-16ee-4c93-ac37-11c20cfb7c0c tempest-GroupSnapshotsTest-1521244586 None] Update group completed successfully. Jun 20 00:04:01 devstack sudo[122100]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-a3ca22bb-908e-43f1-ad19-9a87daa7482e req-f5c405de-f199-4332-bd8f-acc33a4c74a7 tempest-TestMinimumBasicScenario-1501891981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff" returned: 0 in 0.820s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-a3ca22bb-908e-43f1-ad19-9a87daa7482e req-f5c405de-f199-4332-bd8f-acc33a4c74a7 tempest-TestMinimumBasicScenario-1501891981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.029s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1654666343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba59a5ab-b7f0-435a-a124-74dc1fbd3109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='987c700af00941fc81e14e20e35b05e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:03:58Z,use_quota=True,user_id='395620c579d9434984ac31580f5053ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Creating volume ba59a5ab-b7f0-435a-a124-74dc1fbd3109 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:04:01 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:01 devstack sudo[122138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 1073741824 Jun 20 00:04:01 devstack sudo[122138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-a3ca22bb-908e-43f1-ad19-9a87daa7482e req-f5c405de-f199-4332-bd8f-acc33a4c74a7 tempest-TestMinimumBasicScenario-1501891981 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6abad7c7-1342-428e-a2ae-9981f3434494', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:04:01 devstack sudo[122111]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-95127945-0873-4c97-a13a-f29dec29ea8e" returned: 0 in 0.711s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-95127945-0873-4c97-a13a-f29dec29ea8e" released by "delete_volume" :: held 1.555s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:01 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-a3ca22bb-908e-43f1-ad19-9a87daa7482e req-f5c405de-f199-4332-bd8f-acc33a4c74a7 tempest-TestMinimumBasicScenario-1501891981 None] attachment_update completed successfully. Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Created reservations ['6c9431f0-e7a7-4c27-8fcb-e3f608ed219a', 'a992ecb8-9a2c-4208-b839-e06e34f99901', '9efc83fd-8c83-48b4-a7b4-f00fdc749172', '8c7fc00b-50c2-4b66-93fb-5f579fa41b93'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:01 devstack sudo[122146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:01 devstack sudo[122146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-431331d9-5980-4e63-9418-0aca51d0bd72-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-431331d9-5980-4e63-9418-0aca51d0bd72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-4942cc32-9146-4224-bc55-b369c2eb5488" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-4942cc32-9146-4224-bc55-b369c2eb5488" acquired by "delete_snapshot" :: waited 0.061s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-431331d9-5980-4e63-9418-0aca51d0bd72" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-431331d9-5980-4e63-9418-0aca51d0bd72" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Deleting offline snapshot 431331d9-5980-4e63-9418-0aca51d0bd72 of volume 4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] snapshot_file for this snap is: volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd4a2e0-2379-435f-9d8a-7b36974b8430]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:02 devstack sudo[122138]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 1073741824" returned: 0 in 1.040s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:02 devstack sudo[122146]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.846s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Deleted volume successfully. Jun 20 00:04:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-faf70182-52b6-4d74-9726-aff007a7be68 tempest-GroupSnapshotsTest-1521244586 None] Update group completed successfully. Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf76e631-e559-4a41-b196-63d692a369d9 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-95127945-0873-4c97-a13a-f29dec29ea8e-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:02 devstack sudo[122247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 Jun 20 00:04:02 devstack sudo[122247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:02 devstack sudo[122244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 Jun 20 00:04:02 devstack sudo[122244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:03 devstack sudo[122247]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109" returned: 0 in 0.685s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d074a7-0872-4cac-95f6-a2b0861c2ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d738a020-215d-4c63-be09-2c0c9453907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:03 devstack sudo[122244]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72" returned: 0 in 0.830s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4942cc32-9146-4224-bc55-b369c2eb5488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:04:03 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Volume volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 (ba59a5ab-b7f0-435a-a124-74dc1fbd3109): created successfully Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d738a020-215d-4c63-be09-2c0c9453907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Flow 'volume_create_manager' (ba5e69bc-af6d-4219-8434-6083114d3e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0659ca-5905-45bf-adca-a5d964ab164e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b6905db9-7596-4a04-8f8d-dd68b5e72a9a tempest-VolumesTransfersV357Test-1607410627 None] Created volume successfully. Jun 20 00:04:03 devstack sudo[122595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 Jun 20 00:04:03 devstack sudo[122595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-838bffea-6c5f-4cc8-b8e5-e27731804f92 tempest-GroupSnapshotsTest-1521244586 None] Update group completed successfully. Jun 20 00:04:04 devstack sudo[122595]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488" returned: 0 in 0.820s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:04 devstack sudo[122624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 Jun 20 00:04:04 devstack sudo[122624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b9dec107-dad6-47be-bc56-1c99d32f05eb tempest-VolumesTransfersV357Test-667786201 None] Transfer volume completed successfully. Jun 20 00:04:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e26644d8-8bb4-4662-8bca-ccb98be9a010 tempest-GroupSnapshotsTest-1521244586 None] Update group completed successfully. Jun 20 00:04:05 devstack sudo[122624]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72" returned: 0 in 0.820s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:05 devstack sudo[122655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72 Jun 20 00:04:05 devstack sudo[122655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Acquiring lock "cinder-ba59a5ab-b7f0-435a-a124-74dc1fbd3109-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Lock "cinder-ba59a5ab-b7f0-435a-a124-74dc1fbd3109-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Acquiring lock "cinder-quobyte-ba59a5ab-b7f0-435a-a124-74dc1fbd3109" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Lock "cinder-quobyte-ba59a5ab-b7f0-435a-a124-74dc1fbd3109" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57329c0f-df40-47cb-bf32-448075a9b58d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:05 devstack sudo[122669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 Jun 20 00:04:05 devstack sudo[122669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:05 devstack sudo[122655]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488.431331d9-5980-4e63-9418-0aca51d0bd72" returned: 0 in 0.686s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-431331d9-5980-4e63-9418-0aca51d0bd72" released by "_delete_snapshot" :: held 3.301s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-4942cc32-9146-4224-bc55-b369c2eb5488" released by "delete_snapshot" :: held 3.337s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Created reservations ['b7273a23-d2ad-4dab-93cb-57bb4b831f0b', '9f81e624-795e-4a39-bbd5-9188cc9cb20a', '4bcbe028-d000-48d7-bf34-6130350c4769', '076cbbb5-334d-4385-8456-8e2d8ebf9202'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Delete snapshot completed successfully. Jun 20 00:04:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e8a84ca2-5159-4465-9484-60fb09afef51 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-431331d9-5980-4e63-9418-0aca51d0bd72-delete_snapshot" released by "delete_snapshot" :: held 3.547s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:06 devstack sudo[122669]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109" returned: 0 in 0.819s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:06 devstack sudo[122699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109 Jun 20 00:04:06 devstack sudo[122699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:06 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] GroupSnapshot dfec26b5-d196-447f-a5f2-6a1a2e9012de: creating. Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Group snapshot dfec26b5-d196-447f-a5f2-6a1a2e9012de: creating. {{(pid=93391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Creating offline snapshot 56482582-d5e6-4a65-9b42-70dcd714a881 of volume b85976d8-5568-49d8-b84a-29d873248303 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35917bbd-8e00-4177-b7ed-5a2e9e91b2cb]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:06 devstack sudo[122710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 Jun 20 00:04:06 devstack sudo[122710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-4942cc32-9146-4224-bc55-b369c2eb5488-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-4942cc32-9146-4224-bc55-b369c2eb5488-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-4942cc32-9146-4224-bc55-b369c2eb5488" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-4942cc32-9146-4224-bc55-b369c2eb5488" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ec4846-747a-48c3-adf5-5f67d0b85be8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:06 devstack sudo[122720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 Jun 20 00:04:06 devstack sudo[122720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:06 devstack sudo[122699]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ba59a5ab-b7f0-435a-a124-74dc1fbd3109" returned: 0 in 0.721s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Lock "cinder-quobyte-ba59a5ab-b7f0-435a-a124-74dc1fbd3109" released by "delete_volume" :: held 1.595s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Created reservations ['7c06157d-2ced-4dc1-9e4f-e8fe5fc0c7bb', '7ef96ed0-7225-4fec-bfbe-83f6848667ef', '6ab6bb4e-29bf-46d3-8487-461e8ced4155', 'f060ff73-12f2-45fa-b06b-55c9c06321a6'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:07 devstack sudo[122733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:07 devstack sudo[122733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:07 devstack sudo[122710]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303" returned: 0 in 0.903s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:07 devstack sudo[122748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 1G Jun 20 00:04:07 devstack sudo[122748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:07 devstack sudo[122720]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488" returned: 0 in 1.131s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:07 devstack sudo[122770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488 Jun 20 00:04:07 devstack sudo[122770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:07 devstack sudo[122733]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.820s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Deleted volume successfully. Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8d18c16c-347e-4111-b171-028f2f808e01 tempest-VolumesTransfersV357Test-1399547663 None] Lock "cinder-ba59a5ab-b7f0-435a-a124-74dc1fbd3109-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Flow 'volume_create_manager' (d14beed8-cbbd-44c1-b975-cdf9cbc3551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd8cb67-35fd-436c-a373-a42afcfc8b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd8cb67-35fd-436c-a373-a42afcfc8b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1487138094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1ef460-130f-4233-ac1a-f1a3e8aed5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='987c700af00941fc81e14e20e35b05e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:09Z,use_quota=True,user_id='395620c579d9434984ac31580f5053ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b8cef0-c568-41b4-bd83-34871cd75a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b8cef0-c568-41b4-bd83-34871cd75a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:08 devstack sudo[122748]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4455fb32-3c3c-4f92-8279-3605e599b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4455fb32-3c3c-4f92-8279-3605e599b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1ef460-130f-4233-ac1a-f1a3e8aed5bd', 'volume_name': 'volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f209ff8d-80d2-40be-8437-61ffd594e209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f209ff8d-80d2-40be-8437-61ffd594e209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c6123a-ede3-44ea-9438-29855e0019d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:08 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Volume fe1ef460-130f-4233-ac1a-f1a3e8aed5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd', 'volume_size': 1} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 1G" returned: 0 in 1.280s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85976d8-5568-49d8-b84a-29d873248303 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:08 devstack sudo[122801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85976d8-5568-49d8-b84a-29d873248303 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 Jun 20 00:04:08 devstack sudo[122801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:08 devstack sudo[122770]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4942cc32-9146-4224-bc55-b369c2eb5488" returned: 0 in 0.912s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-4942cc32-9146-4224-bc55-b369c2eb5488" released by "delete_volume" :: held 2.119s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:08 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Created reservations ['9d64da46-470a-496a-a226-df496e469389', '28c24b1e-685e-4ee5-9a25-5ef42899a609', '5e860091-29d9-4dd2-bdfa-369f353e6e9c', 'd66a1e3e-1abb-436d-83d0-7abbefbb9081'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:09 devstack sudo[122812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:09 devstack sudo[122812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:09 devstack sudo[122801]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b85976d8-5568-49d8-b84a-29d873248303 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881" returned: 0 in 0.758s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:09 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:09 devstack sudo[122831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 Jun 20 00:04:09 devstack sudo[122831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:09 devstack sudo[122812]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.728s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Deleted volume successfully. Jun 20 00:04:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-05c4c24b-0f52-4e1a-9203-143d9c25930c tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-4942cc32-9146-4224-bc55-b369c2eb5488-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:10 devstack sudo[122831]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881" returned: 0 in 0.749s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:10 devstack sudo[122861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.info Jun 20 00:04:10 devstack sudo[122861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (0fa3ab64-8a16-428e-925e-ef4eaeb5dc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b408fa-acea-41fc-bbce-b2bb9d9cc954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b408fa-acea-41fc-bbce-b2bb9d9cc954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-383961886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b144aab0-6a9b-4047-b9bf-7d405fe0af6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79014f628b8c464a82c5df6b1988f1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:11Z,use_quota=True,user_id='93589cee300c404faaa654226956c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b83071-3ef1-4340-861a-e95bd8c62dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b83071-3ef1-4340-861a-e95bd8c62dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e30642-defc-48a3-a943-40f0aa18ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e30642-defc-48a3-a943-40f0aa18ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b144aab0-6a9b-4047-b9bf-7d405fe0af6d', 'volume_name': 'volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abda181-23bd-419d-95ec-133bd599955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abda181-23bd-419d-95ec-133bd599955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d4d5e7-7f9b-4acd-9bfe-b0f498d514b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:10 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume b144aab0-6a9b-4047-b9bf-7d405fe0af6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d', 'volume_size': 1} Jun 20 00:04:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:11 devstack sudo[122861]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.info" returned: 0 in 0.827s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:11 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.info is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:04:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:11 devstack sudo[122895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.info Jun 20 00:04:11 devstack sudo[122895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:11 devstack sudo[122895]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.info" returned: 0 in 0.843s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.475s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Creating offline snapshot 5bab08a5-681a-447b-a053-b7f5efbc8b5d of volume 3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:04:12 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[945b8a74-71a1-4a02-ba7e-ad4c7fe63e83]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:12 devstack sudo[122927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc Jun 20 00:04:12 devstack sudo[122927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:12 devstack sudo[122927]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" returned: 0 in 0.957s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:13 devstack sudo[122962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d 1G Jun 20 00:04:13 devstack sudo[122962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:13 devstack sudo[122962]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d 1G" returned: 0 in 0.864s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:13 devstack sudo[122992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d Jun 20 00:04:13 devstack sudo[122992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:14 devstack sudo[122992]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d" returned: 0 in 0.727s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:14 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:04:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:14 devstack sudo[123021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d Jun 20 00:04:14 devstack sudo[123021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:15 devstack sudo[123021]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d" returned: 0 in 0.681s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:15 devstack sudo[123082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.info Jun 20 00:04:15 devstack sudo[123082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:15 devstack sudo[123082]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.info" returned: 0 in 0.676s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:15 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.info is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:04:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:16 devstack sudo[123106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.info Jun 20 00:04:16 devstack sudo[123106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:16 devstack sudo[123106]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.info" returned: 0 in 0.663s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.669s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.660s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-383961886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b144aab0-6a9b-4047-b9bf-7d405fe0af6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79014f628b8c464a82c5df6b1988f1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:11Z,use_quota=True,user_id='93589cee300c404faaa654226956c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Creating volume b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:04:16 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:04:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:16 devstack sudo[123130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d 1073741824 Jun 20 00:04:16 devstack sudo[123130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:16 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ed68ab67-2679-4e86-9d30-5c1b71e7cea4 tempest-GroupSnapshotsTest-1521244586 None] group_snapshot dfec26b5-d196-447f-a5f2-6a1a2e9012de: created successfully Jun 20 00:04:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] group_snapshot dfec26b5-d196-447f-a5f2-6a1a2e9012de: deleting Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] group_snapshot dfec26b5-d196-447f-a5f2-6a1a2e9012de: deleting {{(pid=93391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-b85976d8-5568-49d8-b84a-29d873248303" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-b85976d8-5568-49d8-b84a-29d873248303" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-56482582-d5e6-4a65-9b42-70dcd714a881" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-56482582-d5e6-4a65-9b42-70dcd714a881" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Deleting offline snapshot 56482582-d5e6-4a65-9b42-70dcd714a881 of volume b85976d8-5568-49d8-b84a-29d873248303 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] snapshot_file for this snap is: volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab425af-c130-43e6-9f0b-39a594ecb87d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:17 devstack sudo[123157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 Jun 20 00:04:17 devstack sudo[123157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:17 devstack sudo[123130]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d 1073741824" returned: 0 in 0.926s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:17 devstack sudo[123168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d Jun 20 00:04:17 devstack sudo[123168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:18 devstack sudo[123157]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881" returned: 0 in 0.834s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b85976d8-5568-49d8-b84a-29d873248303(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f78d3df-9953-48cb-bbbf-1e2a959b1a8c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:18 devstack sudo[123168]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" returned: 0 in 0.715s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.627s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1487138094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1ef460-130f-4233-ac1a-f1a3e8aed5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='987c700af00941fc81e14e20e35b05e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:09Z,use_quota=True,user_id='395620c579d9434984ac31580f5053ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Creating volume fe1ef460-130f-4233-ac1a-f1a3e8aed5bd {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:04:18 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:18 devstack sudo[123192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 Jun 20 00:04:18 devstack sudo[123192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d4d5e7-7f9b-4acd-9bfe-b0f498d514b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e170ee81-0a1b-40e3-aab8-dd854cecc55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:18 devstack sudo[123197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd 1073741824 Jun 20 00:04:18 devstack sudo[123197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:18 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Volume volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d (b144aab0-6a9b-4047-b9bf-7d405fe0af6d): created successfully Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e170ee81-0a1b-40e3-aab8-dd854cecc55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (0fa3ab64-8a16-428e-925e-ef4eaeb5dc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c0dfe422-dd66-4c23-a2e3-71f34c7d4725 tempest-VolumesSnapshotTestJSON-1211356176 None] Created volume successfully. Jun 20 00:04:19 devstack sudo[123192]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303" returned: 0 in 0.827s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:19 devstack sudo[123226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 Jun 20 00:04:19 devstack sudo[123226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:19 devstack sudo[123197]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd 1073741824" returned: 0 in 0.874s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:19 devstack sudo[123234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd Jun 20 00:04:19 devstack sudo[123234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:19 devstack sudo[123226]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881" returned: 0 in 0.855s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:19 devstack sudo[123261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881 Jun 20 00:04:19 devstack sudo[123261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:20 devstack sudo[123234]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd" returned: 0 in 0.709s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.483s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c6123a-ede3-44ea-9438-29855e0019d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a21b0cf-1c85-4c1d-bfc9-c7c30c653a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Creating offline snapshot 08ce0b07-bada-4354-b197-40cd7fd96d9b of volume b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:04:20 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Volume volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd (fe1ef460-130f-4233-ac1a-f1a3e8aed5bd): created successfully Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a21b0cf-1c85-4c1d-bfc9-c7c30c653a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Flow 'volume_create_manager' (d14beed8-cbbd-44c1-b975-cdf9cbc3551f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35051e3-a26c-4041-8a65-b00cf9d082f2]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-06284460-986e-45c3-aa6e-d93db53a736f tempest-VolumesTransfersV357Test-1607410627 None] Created volume successfully. Jun 20 00:04:20 devstack sudo[123266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d Jun 20 00:04:20 devstack sudo[123266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:20 devstack sudo[123261]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303.56482582-d5e6-4a65-9b42-70dcd714a881" returned: 0 in 0.662s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-56482582-d5e6-4a65-9b42-70dcd714a881" released by "_delete_snapshot" :: held 3.295s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-b85976d8-5568-49d8-b84a-29d873248303" released by "delete_snapshot" :: held 3.322s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-5bab08a5-681a-447b-a053-b7f5efbc8b5d" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-5bab08a5-681a-447b-a053-b7f5efbc8b5d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Deleting offline snapshot 5bab08a5-681a-447b-a053-b7f5efbc8b5d of volume 3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] snapshot_file for this snap is: volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[975de5d6-f5a6-4622-b577-29e040ec73f6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:21 devstack sudo[123304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d Jun 20 00:04:21 devstack sudo[123304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Acquiring lock "cinder-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Lock "cinder-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:21 devstack sudo[123266]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" returned: 0 in 1.000s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:21 devstack sudo[123325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b 1G Jun 20 00:04:21 devstack sudo[123325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Acquiring lock "cinder-quobyte-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Lock "cinder-quobyte-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:21 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63f2a63-595f-4aa0-9446-02c29f413964]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:21 devstack sudo[123330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd Jun 20 00:04:21 devstack sudo[123330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:22 devstack sudo[123304]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d" returned: 0 in 1.269s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:04:22 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[375dfe5f-731d-4878-b71c-322492def15f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:22 devstack sudo[123325]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b 1G" returned: 0 in 1.180s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:22 devstack sudo[123393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc Jun 20 00:04:22 devstack sudo[123393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:22 devstack sudo[123330]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd" returned: 0 in 1.092s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:22 devstack sudo[123402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b Jun 20 00:04:22 devstack sudo[123402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:22 devstack sudo[123428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd Jun 20 00:04:22 devstack sudo[123428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:23 devstack sudo[123393]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" returned: 0 in 1.229s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:23 devstack sudo[123526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d Jun 20 00:04:23 devstack sudo[123526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:23 devstack sudo[123428]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd" returned: 0 in 1.229s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Lock "cinder-quobyte-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd" released by "delete_volume" :: held 2.406s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:23 devstack sudo[123402]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b" returned: 0 in 1.377s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:23 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b is being set with open permissions: ugo+rw Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:23 devstack sudo[123542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b Jun 20 00:04:23 devstack sudo[123542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Created reservations ['52691346-cb1a-4652-98e7-fe7204266b12', '4b7ee5df-b022-4b98-80d0-a75d80d8cd98', '3cbe64a9-0299-48ec-aeb7-5fc10fa37e29', '12819395-bbc0-4308-b9fa-2e78d9c44334'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:23 devstack sudo[123553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:23 devstack sudo[123553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:24 devstack sudo[123553]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.853s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:24 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:24 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Deleted volume successfully. Jun 20 00:04:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-622b0a90-bfea-46db-8e02-55aca6bf2e5a tempest-VolumesTransfersV357Test-1399547663 None] Lock "cinder-fe1ef460-130f-4233-ac1a-f1a3e8aed5bd-delete_volume" released by "delete_volume" :: held 3.687s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:24 devstack sudo[123526]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d" returned: 0 in 1.553s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:24 devstack sudo[123542]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b" returned: 0 in 1.309s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:24 devstack sudo[123599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d Jun 20 00:04:24 devstack sudo[123599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:25 devstack sudo[123602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.info Jun 20 00:04:25 devstack sudo[123602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:25 devstack sudo[123599]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc.5bab08a5-681a-447b-a053-b7f5efbc8b5d" returned: 0 in 0.934s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:25 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-5bab08a5-681a-447b-a053-b7f5efbc8b5d" released by "_delete_snapshot" :: held 5.218s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:25 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" released by "delete_snapshot" :: held 5.254s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:26 devstack sudo[123602]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.info" returned: 0 in 1.081s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:26 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.info is being set with open permissions: ugo+rw Jun 20 00:04:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:26 devstack cinder-volume[93391]: WARNING cinder.quota [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1813245224 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1813245224, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:04:26 devstack cinder-volume[93391]: WARNING cinder.quota [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1813245224 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1813245224, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:04:26 devstack sudo[123641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.info Jun 20 00:04:26 devstack sudo[123641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:26 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['139f282a-b973-4577-8955-c8a89af7bab1', 'a2607975-8108-49e8-93c5-72f7f6cd325e', 'a61a5d78-e322-417a-946b-58884d8974d3', 'd4ad7c34-bdd6-4900-85cf-7d456aa01b04'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:26 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['de81de7e-1d7d-419f-92a8-b1dd5507eb15', 'b7bfc398-737f-4f64-91bd-d2cc296107bc', '8272a41f-5d29-4a81-8fa1-840cc95cc1c2', 'f7acfb17-f111-4333-b3b6-1f4ad82a924a'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:26 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-06372a2e-c734-42d0-b85c-f61c79227f1e tempest-GroupSnapshotsTest-1521244586 None] group_snapshot dfec26b5-d196-447f-a5f2-6a1a2e9012de: deleted successfully Jun 20 00:04:26 devstack sudo[123641]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.info" returned: 0 in 0.861s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.960s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-64faa018-498e-45cd-8186-e5a7a5fc5e1b tempest-VolumesSnapshotTestJSON-1211356176 None] Create snapshot completed successfully Jun 20 00:04:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:27 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f77f4d-ddb5-4e6d-b26f-71c2e4be2c5f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:27 devstack sudo[123697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc Jun 20 00:04:27 devstack sudo[123697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:04:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:28 devstack sudo[123706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:28 devstack sudo[123706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:29 devstack sudo[123697]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" returned: 0 in 1.275s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:29 devstack sudo[123742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc Jun 20 00:04:29 devstack sudo[123742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:29 devstack sudo[123706]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.255s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (bdd8c679-b971-4e89-b2ea-630d87a9b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbb68fb-b433-4628-9435-902f58b5e072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbb68fb-b433-4628-9435-902f58b5e072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1909787452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9bb5cc-8432-4272-bf2f-20be1c4eec52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79014f628b8c464a82c5df6b1988f1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08ce0b07-bada-4354-b197-40cd7fd96d9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:29Z,use_quota=True,user_id='93589cee300c404faaa654226956c26c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf579f54-08f9-4c5a-b107-8ecd0948b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf579f54-08f9-4c5a-b107-8ecd0948b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385af363-4e23-4362-b8ff-65d86e5b6cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385af363-4e23-4362-b8ff-65d86e5b6cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a9bb5cc-8432-4272-bf2f-20be1c4eec52', 'volume_name': 'volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52', 'volume_size': 1, 'snapshot_id': '08ce0b07-bada-4354-b197-40cd7fd96d9b'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26eb8210-cf0e-4b63-8c7e-f82eead916fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26eb8210-cf0e-4b63-8c7e-f82eead916fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f12bf2-3ca3-430f-97b4-19d57f259777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:29 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Volume 0a9bb5cc-8432-4272-bf2f-20be1c4eec52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52', 'volume_size': 1, 'snapshot_id': '08ce0b07-bada-4354-b197-40cd7fd96d9b'} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-08ce0b07-bada-4354-b197-40cd7fd96d9b-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-08ce0b07-bada-4354-b197-40cd7fd96d9b-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Creating volume 0a9bb5cc-8432-4272-bf2f-20be1c4eec52 from snapshot 08ce0b07-bada-4354-b197-40cd7fd96d9b {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] snapshot: 08ce0b07-bada-4354-b197-40cd7fd96d9b, volume: 0a9bb5cc-8432-4272-bf2f-20be1c4eec52, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f2dae8-0c64-4903-9687-6a906a9c2afa]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:29 devstack sudo[123761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b Jun 20 00:04:29 devstack sudo[123761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:29 devstack sudo[123742]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" returned: 0 in 0.870s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-3fcc1878-f8ac-4d7b-a4cc-0cbefac3a8fc" released by "delete_volume" :: held 2.271s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-b85976d8-5568-49d8-b84a-29d873248303" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-b85976d8-5568-49d8-b84a-29d873248303" acquired by "delete_volume" :: waited 0.041s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65982351-4f5f-47f4-a4b3-5fb2ec3b822f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:30 devstack sudo[123778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 Jun 20 00:04:30 devstack sudo[123778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:30 devstack sudo[123761]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b" returned: 0 in 1.188s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[090af1fd-9800-452c-b25d-f8844af357b0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:31 devstack sudo[123807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d Jun 20 00:04:31 devstack sudo[123807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:31 devstack sudo[123778]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303" returned: 0 in 0.892s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:31 devstack sudo[123815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303 Jun 20 00:04:31 devstack sudo[123815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:31 devstack sudo[123815]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b85976d8-5568-49d8-b84a-29d873248303" returned: 0 in 0.841s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-b85976d8-5568-49d8-b84a-29d873248303" released by "delete_volume" :: held 1.836s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:31 devstack sudo[123807]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" returned: 0 in 1.101s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:31 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:04:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:32 devstack sudo[123849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 Jun 20 00:04:32 devstack sudo[123849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['daa1c4dd-2a74-42aa-9683-5f660d34ed7f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:32 devstack cinder-volume[93391]: WARNING cinder.quota [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1813245224 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1813245224, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['f9fa454f-c589-4004-9f24-83036e7a574c', '46822f32-6f62-4bda-8dfe-86ea95bac48e', '01b8585a-ee62-4473-8202-efecb25be0fb', '85fe84bb-9aa9-4c7b-8e9e-7c9eac2129bf'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['3ab10f49-169c-428c-accf-2ac5d135d549', 'ce28d941-20ec-45c5-aac6-250aec307c52', '96ee7d4c-b92d-4feb-b868-5da66efdd946', '142af470-3abe-4ba9-b3f8-128c8710bca3'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:32 devstack sudo[123866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:32 devstack sudo[123866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Flow 'volume_create_manager' (12c5e3c6-8df0-4c08-93b6-b719a775ff01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adeea69a-9d95-457f-a70b-4234ce8ae51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adeea69a-9d95-457f-a70b-4234ce8ae51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1150816338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd2ac39-fa89-4181-96d6-7d0f01dc4e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11be3ea2ca694420b7eb97b899c05616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:33Z,use_quota=True,user_id='7de3d31aa1ab41dca8b443266a0d30a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a973f4-9fae-401b-b32d-7fac6da31ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a973f4-9fae-401b-b32d-7fac6da31ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5ed90d-2a71-46da-a342-73354f9cc250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5ed90d-2a71-46da-a342-73354f9cc250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd2ac39-fa89-4181-96d6-7d0f01dc4e75', 'volume_name': 'volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac7d62e-9f33-43ec-ae1c-010c86ea69de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac7d62e-9f33-43ec-ae1c-010c86ea69de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd670e8-8b9b-42f7-b461-e6b330ef2ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:32 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Volume 5fd2ac39-fa89-4181-96d6-7d0f01dc4e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75', 'volume_size': 1} Jun 20 00:04:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:34 devstack sudo[123866]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.542s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:34 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-302cecd4-b5ff-492c-a921-355ce4ae240e tempest-GroupSnapshotsTest-1521244586 None] Delete group completed successfully. Jun 20 00:04:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2d866b31-d50d-422a-89e6-95be81459576 tempest-GroupSnapshotsTest-1521244586 None] Group tempest-GroupSnapshotsTest-Group-714466338: creating Jun 20 00:04:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2d866b31-d50d-422a-89e6-95be81459576 tempest-GroupSnapshotsTest-1521244586 None] Group tempest-GroupSnapshotsTest-Group-714466338: created successfully Jun 20 00:04:34 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2d866b31-d50d-422a-89e6-95be81459576 tempest-GroupSnapshotsTest-1521244586 None] Create group completed successfully. Jun 20 00:04:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Flow 'volume_create_manager' (792c1024-1188-4539-982f-1b5b26bdda93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaee3899-eaed-4ac9-b733-c53cfdde0d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaee3899-eaed-4ac9-b733-c53cfdde0d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1636643013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54095065-f785-4113-9998-05face520bc0,host='devstack@QuobyteHD#QuobyteHD',id=e5986b72-082b-44ec-ab57-b513be6af49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a46d2846bcb4f0393102595f5026602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:37Z,use_quota=True,user_id='9c7ccd0941af457cbbf9ba2fb6fdd4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e170693e-6ed2-43b4-8833-665ffb977553),volume_type_id=e170693e-6ed2-43b4-8833-665ffb977553)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f751de-132e-4e80-b634-e17015b40204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f751de-132e-4e80-b634-e17015b40204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15df8ad7-1454-435e-ab64-115feed0d372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15df8ad7-1454-435e-ab64-115feed0d372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5986b72-082b-44ec-ab57-b513be6af49e', 'volume_name': 'volume-e5986b72-082b-44ec-ab57-b513be6af49e', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f944a972-3bbb-45ad-a761-7c92e98a0e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f944a972-3bbb-45ad-a761-7c92e98a0e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531af747-9efc-434a-8579-0eaba8ec5040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Volume e5986b72-082b-44ec-ab57-b513be6af49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5986b72-082b-44ec-ab57-b513be6af49e', 'volume_size': 1} Jun 20 00:04:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:39 devstack sudo[123849]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" returned: 0 in 7.198s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:39 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a39cf2-8540-4a2a-a199-5f068ad6fe1a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:39 devstack sudo[124085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d Jun 20 00:04:39 devstack sudo[124085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:40 devstack sudo[124085]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" returned: 0 in 0.934s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:04:40 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Converted 1024.00 MB image at 142.24 MB/s Jun 20 00:04:40 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 is being set with open permissions: ugo+rw Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:40 devstack sudo[124121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 Jun 20 00:04:40 devstack sudo[124121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:40 devstack sudo[124121]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" returned: 0 in 0.634s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" released by "_copy_volume_from_snapshot" :: held 11.163s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-08ce0b07-bada-4354-b197-40cd7fd96d9b-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" released by "_create_volume_from_snapshot" :: held 11.209s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.232s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.891s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1150816338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd2ac39-fa89-4181-96d6-7d0f01dc4e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11be3ea2ca694420b7eb97b899c05616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:33Z,use_quota=True,user_id='7de3d31aa1ab41dca8b443266a0d30a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Creating volume 5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:04:40 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:40 devstack sudo[124142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 1073741824 Jun 20 00:04:40 devstack sudo[124142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79f12bf2-3ca3-430f-97b4-19d57f259777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52', 'volume_size': 1, 'snapshot_id': '08ce0b07-bada-4354-b197-40cd7fd96d9b'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf07c73-2d05-41d0-8602-58ed04c1c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:40 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Volume volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 (0a9bb5cc-8432-4272-bf2f-20be1c4eec52): created successfully Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf07c73-2d05-41d0-8602-58ed04c1c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Flow 'volume_create_manager' (bdd8c679-b971-4e89-b2ea-630d87a9b892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-710c3c99-b007-4b23-8cf5-002f7acfec8d tempest-VolumesSnapshotTestJSON-1211356176 None] Created volume successfully. Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-0a9bb5cc-8432-4272-bf2f-20be1c4eec52-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-0a9bb5cc-8432-4272-bf2f-20be1c4eec52-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:41 devstack sudo[124142]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=143,cinder:INSERT=29,cinder:UPDATE=139,cinder:DELETE=8 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 1073741824" returned: 0 in 0.843s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=115,cinder:INSERT=39,cinder:UPDATE=144,cinder:DELETE=8 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:41 devstack sudo[124176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 Jun 20 00:04:41 devstack sudo[124176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb1a8a5-4088-4203-ad92-db9666541498]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:41 devstack sudo[124181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 Jun 20 00:04:41 devstack sudo[124181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:42 devstack sudo[124176]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" returned: 0 in 0.655s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.105s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54095065-f785-4113-9998-05face520bc0,created_at=2026-06-19T22:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1636643013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54095065-f785-4113-9998-05face520bc0,host='devstack@QuobyteHD#QuobyteHD',id=e5986b72-082b-44ec-ab57-b513be6af49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a46d2846bcb4f0393102595f5026602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:37Z,use_quota=True,user_id='9c7ccd0941af457cbbf9ba2fb6fdd4f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e170693e-6ed2-43b4-8833-665ffb977553),volume_type_id=e170693e-6ed2-43b4-8833-665ffb977553)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Creating volume e5986b72-082b-44ec-ab57-b513be6af49e {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:04:42 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd670e8-8b9b-42f7-b461-e6b330ef2ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:42 devstack sudo[124202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e 1073741824 Jun 20 00:04:42 devstack sudo[124202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3ce3a7-076d-4cce-9707-ee123f23ef99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:42 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Volume volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 (5fd2ac39-fa89-4181-96d6-7d0f01dc4e75): created successfully Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3ce3a7-076d-4cce-9707-ee123f23ef99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Flow 'volume_create_manager' (12c5e3c6-8df0-4c08-93b6-b719a775ff01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:42 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2f7faa5c-305d-44c0-b1ec-e9427118a706 tempest-VolumesCloneTest-2092698541 None] Created volume successfully. Jun 20 00:04:42 devstack sudo[124181]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" returned: 0 in 0.814s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:42 devstack sudo[124214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52 Jun 20 00:04:42 devstack sudo[124214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:43 devstack sudo[124214]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" returned: 0 in 0.717s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-0a9bb5cc-8432-4272-bf2f-20be1c4eec52" released by "delete_volume" :: held 1.590s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Created reservations ['cd4b7235-0bf5-4ef4-894d-0cf7da83dace', 'f8af2a9b-ba04-4348-b9ef-6ebd6e73dc30', 'b144b075-d561-4aa4-bfd6-abd3ce25681b', '1db72e74-2bff-4586-83d5-45e375e0ff4d'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:43 devstack sudo[124202]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e 1073741824" returned: 0 in 1.013s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:43 devstack sudo[124250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e Jun 20 00:04:43 devstack sudo[124250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:43 devstack sudo[124253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:43 devstack sudo[124253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Flow 'volume_create_manager' (e5cfe07c-18c9-423c-ae15-c3106e884b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e257eb6c-e5af-43cc-a17a-0ff388838dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e257eb6c-e5af-43cc-a17a-0ff388838dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1383006090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5bedecd-e029-432c-8f14-37175d3ffc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11be3ea2ca694420b7eb97b899c05616',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:04:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5fd2ac39-fa89-4181-96d6-7d0f01dc4e75,status='creating',terminated_at=None,updated_at=2026-06-19T22:04:44Z,use_quota=True,user_id='7de3d31aa1ab41dca8b443266a0d30a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816002de-f603-422b-9cdb-9a88c2426671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816002de-f603-422b-9cdb-9a88c2426671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b168108-6cfd-4d4b-89bd-3a8a24824930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b168108-6cfd-4d4b-89bd-3a8a24824930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e5bedecd-e029-432c-8f14-37175d3ffc19', 'volume_name': 'volume-e5bedecd-e029-432c-8f14-37175d3ffc19', 'volume_size': 2, 'source_volid': '5fd2ac39-fa89-4181-96d6-7d0f01dc4e75', 'source_volstatus': 'available'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7834a7fc-ef93-4eec-970b-07e719483985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7834a7fc-ef93-4eec-970b-07e719483985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef170b22-54e5-4bf4-a8ee-fc427d0ce05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:43 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Volume e5bedecd-e029-432c-8f14-37175d3ffc19: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e5bedecd-e029-432c-8f14-37175d3ffc19', 'volume_size': 2, 'source_volid': '5fd2ac39-fa89-4181-96d6-7d0f01dc4e75', 'source_volstatus': 'available'} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-08ce0b07-bada-4354-b197-40cd7fd96d9b-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-08ce0b07-bada-4354-b197-40cd7fd96d9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-08ce0b07-bada-4354-b197-40cd7fd96d9b" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-08ce0b07-bada-4354-b197-40cd7fd96d9b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Deleting offline snapshot 08ce0b07-bada-4354-b197-40cd7fd96d9b of volume b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] snapshot_file for this snap is: volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f4e6dc-c561-4831-a944-91cd24620111]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:44 devstack sudo[124273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b Jun 20 00:04:44 devstack sudo[124273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:44 devstack sudo[124253]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.849s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Deleted volume successfully. Jun 20 00:04:44 devstack sudo[124250]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e" returned: 0 in 0.957s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.537s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:44 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Cloning volume 5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 to volume e5bedecd-e029-432c-8f14-37175d3ffc19 Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531af747-9efc-434a-8579-0eaba8ec5040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5986b72-082b-44ec-ab57-b513be6af49e', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30217591-ef3f-44f9-bac8-92d1a1db5542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-89df9e1a-2b78-4195-89de-7d1bc8dc2f0a tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-0a9bb5cc-8432-4272-bf2f-20be1c4eec52-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Volume volume-e5986b72-082b-44ec-ab57-b513be6af49e (e5986b72-082b-44ec-ab57-b513be6af49e): created successfully Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30217591-ef3f-44f9-bac8-92d1a1db5542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Flow 'volume_create_manager' (792c1024-1188-4539-982f-1b5b26bdda93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Creating offline snapshot c3f840a1-acf5-44ce-bab9-c56ef46747e1 of volume 5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:04:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f589a725-d907-4a63-8017-dc8a064938f7 tempest-GroupSnapshotsTest-1521244586 None] Created volume successfully. Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c18f45b-0089-41e5-a5ee-d9ab5ebd7341]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:44 devstack sudo[124289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 Jun 20 00:04:44 devstack sudo[124289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:45 devstack sudo[124273]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b" returned: 0 in 0.914s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:04:45 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e198be-82fa-4566-a4ce-25f017f25b89]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:45 devstack sudo[124309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d Jun 20 00:04:45 devstack sudo[124309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:45 devstack sudo[124289]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" returned: 0 in 0.826s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:45 devstack sudo[124326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 1G Jun 20 00:04:45 devstack sudo[124326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:45 devstack sudo[124309]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" returned: 0 in 0.783s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:45 devstack sudo[124348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b Jun 20 00:04:45 devstack sudo[124348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:45 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] GroupSnapshot 0cd5d2ef-97fb-46d9-8113-3f956b759dec: creating. Jun 20 00:04:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Group snapshot 0cd5d2ef-97fb-46d9-8113-3f956b759dec: creating. {{(pid=93391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 20 00:04:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:46 devstack sudo[124326]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 1G" returned: 0 in 0.955s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:46 devstack sudo[124369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 Jun 20 00:04:46 devstack sudo[124369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:46 devstack sudo[124348]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b" returned: 0 in 0.848s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:46 devstack sudo[124385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b Jun 20 00:04:46 devstack sudo[124385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:47 devstack sudo[124369]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1" returned: 0 in 0.898s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:47 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 is being set with open permissions: ugo+rw Jun 20 00:04:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:47 devstack sudo[124407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 Jun 20 00:04:47 devstack sudo[124407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:47 devstack sudo[124385]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d.08ce0b07-bada-4354-b197-40cd7fd96d9b" returned: 0 in 0.787s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-08ce0b07-bada-4354-b197-40cd7fd96d9b" released by "_delete_snapshot" :: held 3.460s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" released by "delete_snapshot" :: held 3.495s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:47 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Created reservations ['ad189c40-651c-4c11-be9a-772712f75c53', '14531f43-859a-40a5-b033-9b1292c80ad7', 'f6c9defc-6f4d-42d1-a30e-dcda0b551e6d', '96335cc6-8b25-4ce6-a139-f7b88e8452e2'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:47 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Delete snapshot completed successfully. Jun 20 00:04:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d8fcb69b-c34e-4872-ab2f-836b3f333a1d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-08ce0b07-bada-4354-b197-40cd7fd96d9b-delete_snapshot" released by "delete_snapshot" :: held 3.722s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:47 devstack sudo[124407]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1" returned: 0 in 0.783s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:48 devstack sudo[124437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.info Jun 20 00:04:48 devstack sudo[124437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-b144aab0-6a9b-4047-b9bf-7d405fe0af6d-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-b144aab0-6a9b-4047-b9bf-7d405fe0af6d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48490123-9b2b-4248-8abb-52f802fcaeca]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:48 devstack sudo[124451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d Jun 20 00:04:48 devstack sudo[124451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:48 devstack sudo[124437]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.info" returned: 0 in 0.708s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:48 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.info is being set with open permissions: ugo+rw Jun 20 00:04:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:48 devstack sudo[124463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.info Jun 20 00:04:48 devstack sudo[124463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:49 devstack sudo[124451]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" returned: 0 in 0.819s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:49 devstack sudo[124484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d Jun 20 00:04:49 devstack sudo[124484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:49 devstack sudo[124463]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.info" returned: 0 in 0.716s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "cinder-quobyte-e5bedecd-e029-432c-8f14-37175d3ffc19" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Lock "cinder-quobyte-e5bedecd-e029-432c-8f14-37175d3ffc19" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] snapshot: c3f840a1-acf5-44ce-bab9-c56ef46747e1, volume: e5bedecd-e029-432c-8f14-37175d3ffc19, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d84777b-41ab-497c-9e3c-e2504362ef40]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:49 devstack sudo[124496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 Jun 20 00:04:49 devstack sudo[124496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:50 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-bd889b0d-8089-418c-88b8-8ec7f7ffd209 req-f40a8c69-e90e-46b3-8dd9-2d4a5c63d5ce tempest-TestMinimumBasicScenario-1501891981 None] Terminate volume connection completed successfully. Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bd889b0d-8089-418c-88b8-8ec7f7ffd209 req-f40a8c69-e90e-46b3-8dd9-2d4a5c63d5ce tempest-TestMinimumBasicScenario-1501891981 None] Deleting attachment 6abad7c7-1342-428e-a2ae-9981f3434494. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:04:50 devstack sudo[124484]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" returned: 0 in 0.870s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-b144aab0-6a9b-4047-b9bf-7d405fe0af6d" released by "delete_volume" :: held 1.767s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Created reservations ['4cf51ba3-5451-43e8-a736-601105d0de6b', '18e73846-fd2a-4943-8f6b-f3bc5284bf6d', '4db8f796-9bf3-4572-b2ec-5bb7a345cefa', 'fb9c4f97-16b5-46ef-8e2a-b71404d209b5'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:50 devstack sudo[124526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:50 devstack sudo[124526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:50 devstack sudo[124496]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1" returned: 0 in 0.888s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f9555e-af63-48ce-9e8b-396b978f1ae0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:50 devstack sudo[124537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 Jun 20 00:04:50 devstack sudo[124537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-9ee9b8fe-fe1a-44eb-8897-d675024e3811-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-9ee9b8fe-fe1a-44eb-8897-d675024e3811-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "cinder-quobyte-9ee9b8fe-fe1a-44eb-8897-d675024e3811" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-9ee9b8fe-fe1a-44eb-8897-d675024e3811" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6639e54-7098-41b3-a323-961751889b8c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:50 devstack sudo[124548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 Jun 20 00:04:50 devstack sudo[124548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:50 devstack sudo[124526]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.693s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:50 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:50 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Deleted volume successfully. Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-07c0a66e-129d-4fbf-95d4-76926d71c66d tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-b144aab0-6a9b-4047-b9bf-7d405fe0af6d-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:51 devstack sudo[124537]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" returned: 0 in 0.909s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:51 devstack sudo[124572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 Jun 20 00:04:51 devstack sudo[124572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:51 devstack sudo[124548]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811" returned: 0 in 0.795s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:51 devstack sudo[124583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811 Jun 20 00:04:51 devstack sudo[124583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Acquiring lock "cinder-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Lock "cinder-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Acquiring lock "cinder-quobyte-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Lock "cinder-quobyte-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58417672-6bd2-4ae8-920a-1ddc306a0167]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:52 devstack sudo[124597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff Jun 20 00:04:52 devstack sudo[124597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:52 devstack sudo[124583]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ee9b8fe-fe1a-44eb-8897-d675024e3811" returned: 0 in 0.945s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-quobyte-9ee9b8fe-fe1a-44eb-8897-d675024e3811" released by "delete_volume" :: held 1.813s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Created reservations ['567c5a1d-edfb-48bc-abcb-9dd6c4b29bdc', '2ad11c9c-12f7-4a1f-ae6f-4744a0b61ed7', '4d3fe0b0-47a5-4b9c-932d-820934409986', '6936ee31-165a-46e9-862f-b3a9e019f566'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:53 devstack sudo[124639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:53 devstack sudo[124639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:53 devstack sudo[124597]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff" returned: 0 in 1.837s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:53 devstack sudo[124670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff Jun 20 00:04:53 devstack sudo[124670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:54 devstack sudo[124639]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 2.009s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:54 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:54 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Deleted volume successfully. Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-894fc76e-0fd9-49de-930c-8f27552a8253 tempest-VolumesSnapshotTestJSON-1211356176 None] Lock "cinder-9ee9b8fe-fe1a-44eb-8897-d675024e3811-delete_volume" released by "delete_volume" :: held 4.314s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff" returned: 0 in 1.664s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:55 devstack sudo[124670]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Lock "cinder-quobyte-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff" released by "delete_volume" :: held 3.584s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Created reservations ['455a9e49-37a2-4121-9fa1-51cf1096dd33', '8e93dae1-3236-4c8d-a7fd-0c97cfaf42e6', '3b8825cf-185d-4a02-9116-f4a75bb882bf', '81dc309e-780a-465a-980f-c4deca37d9b5'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:04:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:55 devstack sudo[124733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:04:55 devstack sudo[124733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:57 devstack sudo[124733]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.440s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:57 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:04:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Deleted volume successfully. Jun 20 00:04:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-acdcea54-5099-45db-906f-fda0e597cb28 tempest-TestMinimumBasicScenario-1501891981 None] Lock "cinder-9b94ce60-0ec7-45bc-9795-5ed9b646f4ff-delete_volume" released by "delete_volume" :: held 5.441s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:57 devstack sudo[124572]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19" returned: 0 in 6.296s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:57 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71c6fcb-54f5-436b-b9d6-92bdcdbd2a29]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:57 devstack sudo[124793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 Jun 20 00:04:57 devstack sudo[124793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:58 devstack sudo[124793]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" returned: 0 in 1.102s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:58 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:04:58 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Converted 1024.00 MB image at 162.62 MB/s Jun 20 00:04:58 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 is being set with open permissions: ugo+rw Jun 20 00:04:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:58 devstack sudo[124868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 Jun 20 00:04:58 devstack sudo[124868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:04:59 devstack sudo[124868]: pam_unix(sudo:session): session closed for user root Jun 20 00:04:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19" returned: 0 in 0.776s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:04:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Lock "cinder-quobyte-e5bedecd-e029-432c-8f14-37175d3ffc19" released by "_copy_volume_from_snapshot" :: held 10.064s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:04:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "cinder-quobyte-c3f840a1-acf5-44ce-bab9-c56ef46747e1" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:04:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Lock "cinder-quobyte-c3f840a1-acf5-44ce-bab9-c56ef46747e1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:04:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Deleting offline snapshot c3f840a1-acf5-44ce-bab9-c56ef46747e1 of volume 5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:04:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] snapshot_file for this snap is: volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:04:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[173433bf-082e-4147-aa0d-53cc7eec9a61]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:04:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:04:59 devstack sudo[124906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 Jun 20 00:04:59 devstack sudo[124906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:00 devstack sudo[124906]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1" returned: 0 in 0.853s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:05:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea776fa-92fb-4015-aeba-8c5c2761e066]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:00 devstack sudo[124938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 Jun 20 00:05:00 devstack sudo[124938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:01 devstack sudo[124938]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" returned: 0 in 0.886s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:01 devstack sudo[124968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 Jun 20 00:05:01 devstack sudo[124968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:02 devstack sudo[124968]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1" returned: 0 in 0.839s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:02 devstack sudo[125005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1 Jun 20 00:05:02 devstack sudo[125005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:02 devstack sudo[125005]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75.c3f840a1-acf5-44ce-bab9-c56ef46747e1" returned: 0 in 0.660s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Lock "cinder-quobyte-c3f840a1-acf5-44ce-bab9-c56ef46747e1" released by "_delete_snapshot" :: held 3.357s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.620s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.020s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef170b22-54e5-4bf4-a8ee-fc427d0ce05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5bedecd-e029-432c-8f14-37175d3ffc19', 'volume_size': 2, 'source_volid': '5fd2ac39-fa89-4181-96d6-7d0f01dc4e75', 'source_volstatus': 'available'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e95873-5083-4ce8-b57b-2767354b1a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Creating offline snapshot dfc04059-2e40-4429-820c-d5ded6c1da25 of volume e5986b72-082b-44ec-ab57-b513be6af49e {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:05:03 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Volume volume-e5bedecd-e029-432c-8f14-37175d3ffc19 (e5bedecd-e029-432c-8f14-37175d3ffc19): created successfully Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0e95873-5083-4ce8-b57b-2767354b1a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Flow 'volume_create_manager' (e5cfe07c-18c9-423c-ae15-c3106e884b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[783dde5c-65dd-44c7-a2e0-51bc53e27dfe]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-53cbd657-e602-47c2-9298-50712b353ff7 tempest-VolumesCloneTest-2092698541 None] Created volume successfully. Jun 20 00:05:03 devstack sudo[125032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e Jun 20 00:05:03 devstack sudo[125032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "cinder-e5bedecd-e029-432c-8f14-37175d3ffc19-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Lock "cinder-e5bedecd-e029-432c-8f14-37175d3ffc19-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "cinder-quobyte-e5bedecd-e029-432c-8f14-37175d3ffc19" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Lock "cinder-quobyte-e5bedecd-e029-432c-8f14-37175d3ffc19" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c79e87f-1a6c-4fd9-ab9d-73b65dcee20e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:03 devstack sudo[125049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 Jun 20 00:05:03 devstack sudo[125049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:04 devstack sudo[125032]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e" returned: 0 in 1.020s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:04 devstack sudo[125070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 1G Jun 20 00:05:04 devstack sudo[125070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:05:04 devstack sudo[125049]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Flow 'volume_create_manager' (f865886d-c751-4ee4-be41-e7f383dca8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c4ce6e-d284-4eb5-b203-16056bce6e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19" returned: 0 in 1.073s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c4ce6e-d284-4eb5-b203-16056bce6e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1628543824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fdf4cc-35cd-4a1f-9003-a432e07698dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c681598c85f44082afe6256557c4d290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:05Z,use_quota=True,user_id='2d6ba298ce5e492eb614f0ed9a5f43bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:04 devstack sudo[125093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19 Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabc4ed9-8668-49c9-aab2-2f1642f934e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:04 devstack sudo[125093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabc4ed9-8668-49c9-aab2-2f1642f934e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4666d4-29e4-49bf-9880-60c9b3200660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4666d4-29e4-49bf-9880-60c9b3200660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fdf4cc-35cd-4a1f-9003-a432e07698dd', 'volume_name': 'volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd', 'volume_size': 2}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41949fae-da8d-4f3d-851f-12fc9dc0cf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41949fae-da8d-4f3d-851f-12fc9dc0cf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1d9966-7ce1-48cd-b97c-267abe55ac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:04 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Volume 08fdf4cc-35cd-4a1f-9003-a432e07698dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd', 'volume_size': 2} Jun 20 00:05:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:05 devstack sudo[125070]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 1G" returned: 0 in 1.097s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5986b72-082b-44ec-ab57-b513be6af49e -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:05 devstack sudo[125114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5986b72-082b-44ec-ab57-b513be6af49e -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 Jun 20 00:05:05 devstack sudo[125114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:05 devstack sudo[125093]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5bedecd-e029-432c-8f14-37175d3ffc19" returned: 0 in 0.749s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Lock "cinder-quobyte-e5bedecd-e029-432c-8f14-37175d3ffc19" released by "delete_volume" :: held 1.884s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Created reservations ['cda51028-69be-4207-b645-4039f4205fcf', '0fd3e7db-6fff-4b76-8627-657c8a5b8f59', '972d85c4-f2a1-45eb-85aa-e3318cb30b15', '529debb6-e650-4a01-a09a-73b55cd1dffc'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:05 devstack sudo[125129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:05:05 devstack sudo[125129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Acquiring lock "cinder-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Lock "cinder-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Acquiring lock "cinder-quobyte-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Lock "cinder-quobyte-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" acquired by "delete_volume" :: waited 0.037s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5252f2d4-73e8-44af-ba8c-529eee7cfbc4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:06 devstack sudo[125114]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5986b72-082b-44ec-ab57-b513be6af49e -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25" returned: 0 in 0.932s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:06 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:06 devstack sudo[125151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 Jun 20 00:05:06 devstack sudo[125151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:06 devstack sudo[125147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 Jun 20 00:05:06 devstack sudo[125147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:06 devstack sudo[125129]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.824s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:05:06 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Deleted volume successfully. Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-79e98993-7907-4511-a1e5-62f53b822b81 tempest-VolumesCloneTest-2092698541 None] Lock "cinder-e5bedecd-e029-432c-8f14-37175d3ffc19-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:06 devstack sudo[125151]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25" returned: 0 in 0.706s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:06 devstack sudo[125180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.info Jun 20 00:05:06 devstack sudo[125180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:06 devstack sudo[125147]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" returned: 0 in 0.883s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:06 devstack sudo[125185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75 Jun 20 00:05:06 devstack sudo[125185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:07 devstack sudo[125180]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.info" returned: 0 in 0.837s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:07 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:07 devstack sudo[125185]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" returned: 0 in 0.800s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:07 devstack sudo[125213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.info Jun 20 00:05:07 devstack sudo[125213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Lock "cinder-quobyte-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75" released by "delete_volume" :: held 1.775s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Created reservations ['0e0280c2-6bea-4178-b803-716a206521f9', '97a89f8f-2938-4a4d-869c-c1f99b956cdb', '1f9eebe4-3ec2-4294-a821-28bdbb4e41bd', 'f9e109c0-72ce-4311-b85b-ca98a772ffd3'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:07 devstack sudo[125218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:05:07 devstack sudo[125218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:08 devstack sudo[125213]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.info" returned: 0 in 0.941s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.664s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1628543824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fdf4cc-35cd-4a1f-9003-a432e07698dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c681598c85f44082afe6256557c4d290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:05Z,use_quota=True,user_id='2d6ba298ce5e492eb614f0ed9a5f43bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Creating volume 08fdf4cc-35cd-4a1f-9003-a432e07698dd {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:05:08 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd 2147483648 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:08 devstack sudo[125249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd 2147483648 Jun 20 00:05:08 devstack sudo[125249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-aad325ba-51d0-4653-8205-236d9f059132 tempest-GroupSnapshotsTest-1521244586 None] group_snapshot 0cd5d2ef-97fb-46d9-8113-3f956b759dec: created successfully Jun 20 00:05:08 devstack sudo[125218]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.939s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:05:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Deleted volume successfully. Jun 20 00:05:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fce91b4-0c33-4d9e-81b1-99ff9590ad0d tempest-VolumesCloneTest-2092698541 None] Lock "cinder-5fd2ac39-fa89-4181-96d6-7d0f01dc4e75-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] group_snapshot 0cd5d2ef-97fb-46d9-8113-3f956b759dec: deleting Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] group_snapshot 0cd5d2ef-97fb-46d9-8113-3f956b759dec: deleting {{(pid=93391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-e5986b72-082b-44ec-ab57-b513be6af49e" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-e5986b72-082b-44ec-ab57-b513be6af49e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-dfc04059-2e40-4429-820c-d5ded6c1da25" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-dfc04059-2e40-4429-820c-d5ded6c1da25" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Deleting offline snapshot dfc04059-2e40-4429-820c-d5ded6c1da25 of volume e5986b72-082b-44ec-ab57-b513be6af49e {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] snapshot_file for this snap is: volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67f7abe-46f1-46a9-8f48-bf6e373be171]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:10 devstack sudo[125249]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:10 devstack sudo[125294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd 2147483648" returned: 0 in 1.361s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:10 devstack sudo[125294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:10 devstack sudo[125300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd Jun 20 00:05:10 devstack sudo[125300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:10 devstack sudo[125294]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25" returned: 0 in 0.964s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5986b72-082b-44ec-ab57-b513be6af49e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:05:10 devstack sudo[125300]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd" returned: 0 in 0.826s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1633b74f-a14a-49c9-941c-9240a12c13c7]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f1d9966-7ce1-48cd-b97c-267abe55ac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd', 'volume_size': 2}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520c5675-78e3-4cfc-b8ac-04616a18b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:11 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Volume volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd (08fdf4cc-35cd-4a1f-9003-a432e07698dd): created successfully Jun 20 00:05:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520c5675-78e3-4cfc-b8ac-04616a18b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Flow 'volume_create_manager' (f865886d-c751-4ee4-be41-e7f383dca8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:11 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-68bf19a4-2f91-4d51-9435-d0674d552047 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Created volume successfully. Jun 20 00:05:11 devstack sudo[125335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e Jun 20 00:05:11 devstack sudo[125335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:11 devstack sudo[125335]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e" returned: 0 in 0.906s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:11 devstack sudo[125369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 Jun 20 00:05:11 devstack sudo[125369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Flow 'volume_create_manager' (8d247c38-591f-4dd0-be89-c1241255b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e56657-5643-466c-9432-c9578a7bb86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e56657-5643-466c-9432-c9578a7bb86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-968000067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34003791-d3a5-4f58-99a6-9446b9deefbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc996ae71b84448b1d99201bb7bd549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:12Z,use_quota=True,user_id='a9f7585be97e4f1b924d86db316efab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694d2df6-3114-4c99-88eb-e993a752b05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (694d2df6-3114-4c99-88eb-e993a752b05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02507645-2f99-4a1e-bc7a-927dc6fcfc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02507645-2f99-4a1e-bc7a-927dc6fcfc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34003791-d3a5-4f58-99a6-9446b9deefbc', 'volume_name': 'volume-34003791-d3a5-4f58-99a6-9446b9deefbc', 'volume_size': 2}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d202ac27-0c72-42e3-a7bf-29ef85c10a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d202ac27-0c72-42e3-a7bf-29ef85c10a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a52ee-4cdd-4378-9186-478c21fb6aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:12 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Volume 34003791-d3a5-4f58-99a6-9446b9deefbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34003791-d3a5-4f58-99a6-9446b9deefbc', 'volume_size': 2} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-968000067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34003791-d3a5-4f58-99a6-9446b9deefbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc996ae71b84448b1d99201bb7bd549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:12Z,use_quota=True,user_id='a9f7585be97e4f1b924d86db316efab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Creating volume 34003791-d3a5-4f58-99a6-9446b9deefbc {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:05:12 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc 2147483648 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:12 devstack sudo[125383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc 2147483648 Jun 20 00:05:12 devstack sudo[125383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:12 devstack sudo[125369]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25" returned: 0 in 1.056s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:12 devstack sudo[125406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25 Jun 20 00:05:12 devstack sudo[125406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:13 devstack sudo[125383]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc 2147483648" returned: 0 in 1.171s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:13 devstack sudo[125431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc Jun 20 00:05:13 devstack sudo[125431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:13 devstack sudo[125406]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e.dfc04059-2e40-4429-820c-d5ded6c1da25" returned: 0 in 0.780s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-dfc04059-2e40-4429-820c-d5ded6c1da25" released by "_delete_snapshot" :: held 3.873s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-e5986b72-082b-44ec-ab57-b513be6af49e" released by "delete_snapshot" :: held 3.911s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:13 devstack cinder-volume[93391]: WARNING cinder.quota [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1185671715 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1185671715, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:05:13 devstack cinder-volume[93391]: WARNING cinder.quota [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1185671715 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1185671715, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:05:13 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['bb4daebc-716c-490f-9c84-848a30665da5', 'faf5917c-34ff-4c99-ae58-e43ec1e419f0', 'b79a6462-f50d-4ac9-9eec-98d4cdc51053', '267dd69a-5453-4cb4-a5ce-a8d14ed94f09'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:05:13 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f61b65f6-8c78-4489-a8de-7bd9b3a560bd tempest-GroupSnapshotsTest-1521244586 None] group_snapshot 0cd5d2ef-97fb-46d9-8113-3f956b759dec: deleted successfully Jun 20 00:05:14 devstack sudo[125431]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc" returned: 0 in 0.761s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.566s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Creating offline snapshot cdf7f658-79c9-4562-b096-89c513530517 of volume 08fdf4cc-35cd-4a1f-9003-a432e07698dd {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61a52ee-4cdd-4378-9186-478c21fb6aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34003791-d3a5-4f58-99a6-9446b9deefbc', 'volume_size': 2}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36273a5a-618b-4a8c-9cdb-448b1c99e587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8962ebfa-90aa-4989-82cc-c9103d253f58]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:14 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Volume volume-34003791-d3a5-4f58-99a6-9446b9deefbc (34003791-d3a5-4f58-99a6-9446b9deefbc): created successfully Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36273a5a-618b-4a8c-9cdb-448b1c99e587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Flow 'volume_create_manager' (8d247c38-591f-4dd0-be89-c1241255b713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-94f92012-dc43-4169-802a-0e307073e2a0 tempest-VolumesCloneNegativeTest-57344630 None] Created volume successfully. Jun 20 00:05:14 devstack sudo[125459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd Jun 20 00:05:14 devstack sudo[125459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "cinder-quobyte-e5986b72-082b-44ec-ab57-b513be6af49e" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-e5986b72-082b-44ec-ab57-b513be6af49e" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a047774-44e9-4520-8a8e-b3a8ee0aa920]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:14 devstack sudo[125473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e Jun 20 00:05:14 devstack sudo[125473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:15 devstack sudo[125459]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd" returned: 0 in 0.959s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 2G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:15 devstack sudo[125494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 2G Jun 20 00:05:15 devstack sudo[125494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Acquiring lock "cinder-34003791-d3a5-4f58-99a6-9446b9deefbc-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Lock "cinder-34003791-d3a5-4f58-99a6-9446b9deefbc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Acquiring lock "cinder-quobyte-34003791-d3a5-4f58-99a6-9446b9deefbc" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Lock "cinder-quobyte-34003791-d3a5-4f58-99a6-9446b9deefbc" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddbc21d-9b90-46de-9b82-4f12edabd1ee]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:15 devstack sudo[125525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc Jun 20 00:05:15 devstack sudo[125525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:15 devstack sudo[125473]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e" returned: 0 in 1.120s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:15 devstack sudo[125553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e Jun 20 00:05:15 devstack sudo[125553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:16 devstack sudo[125525]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc" returned: 0 in 1.060s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:16 devstack sudo[125494]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 2G" returned: 0 in 1.397s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:16 devstack sudo[125589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc Jun 20 00:05:16 devstack sudo[125589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:16 devstack sudo[125590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 Jun 20 00:05:16 devstack sudo[125590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:16 devstack sudo[125553]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5986b72-082b-44ec-ab57-b513be6af49e" returned: 0 in 0.931s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Lock "cinder-quobyte-e5986b72-082b-44ec-ab57-b513be6af49e" released by "delete_volume" :: held 2.146s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:16 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['ee2a5372-dbcd-444b-8110-1f8c8c89aa45'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:05:16 devstack cinder-volume[93391]: WARNING cinder.quota [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1185671715 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1185671715, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:05:16 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Created reservations ['265ce45d-da4e-4aaa-bdfd-7df0e8ad6998', 'fafea9b9-b57b-404c-a203-758132ad1868', '320f5a3e-677e-425c-a77c-cae9267bb6fd', 'c0a02e1e-8e20-4b1a-bbb4-e126898e9443'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:17 devstack sudo[125606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:05:17 devstack sudo[125606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:17 devstack sudo[125589]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-34003791-d3a5-4f58-99a6-9446b9deefbc" returned: 0 in 0.973s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Lock "cinder-quobyte-34003791-d3a5-4f58-99a6-9446b9deefbc" released by "delete_volume" :: held 2.109s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:17 devstack sudo[125590]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517" returned: 0 in 1.019s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:17 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 is being set with open permissions: ugo+rw Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:17 devstack sudo[125630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 Jun 20 00:05:17 devstack sudo[125630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Created reservations ['29d03c0e-0b63-4a39-b56c-de4c5ab8ae08', '79a83306-94de-4981-a9be-61aab31b893b', '303ac63f-9daa-4827-b5c2-1e092d74bf17', 'bb2fb6e0-0118-47b2-8d5a-89f283606e3f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:17 devstack sudo[125638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:05:17 devstack sudo[125638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:18 devstack sudo[125606]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.069s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:18 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:05:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6e164ee9-ac85-4002-a039-b971cc7e6d3d tempest-GroupSnapshotsTest-1521244586 None] Delete group completed successfully. Jun 20 00:05:18 devstack sudo[125638]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.821s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:18 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:05:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Deleted volume successfully. Jun 20 00:05:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-01e13733-8320-4bd8-9861-26839987826f tempest-VolumesCloneNegativeTest-57344630 None] Lock "cinder-34003791-d3a5-4f58-99a6-9446b9deefbc-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:18 devstack sudo[125630]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517" returned: 0 in 1.173s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:18 devstack sudo[125676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.info Jun 20 00:05:18 devstack sudo[125676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:19 devstack sudo[125676]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.info" returned: 0 in 0.865s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:19 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.info is being set with open permissions: ugo+rw Jun 20 00:05:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:19 devstack sudo[125703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.info Jun 20 00:05:19 devstack sudo[125703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:20 devstack sudo[125703]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.info" returned: 0 in 0.748s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.307s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a6e22c43-7ac4-408d-844c-bda368f026e6 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Create snapshot completed successfully Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "cinder-cdf7f658-79c9-4562-b096-89c513530517-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-cdf7f658-79c9-4562-b096-89c513530517-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "cinder-quobyte-08fdf4cc-35cd-4a1f-9003-a432e07698dd" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-quobyte-08fdf4cc-35cd-4a1f-9003-a432e07698dd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "cinder-quobyte-cdf7f658-79c9-4562-b096-89c513530517" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-quobyte-cdf7f658-79c9-4562-b096-89c513530517" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Deleting offline snapshot cdf7f658-79c9-4562-b096-89c513530517 of volume 08fdf4cc-35cd-4a1f-9003-a432e07698dd {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] snapshot_file for this snap is: volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d80623-c846-4d2d-8fa8-c96c9c4f6c5b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:21 devstack sudo[125754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 Jun 20 00:05:21 devstack sudo[125754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:22 devstack sudo[125754]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517" returned: 0 in 0.930s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:05:22 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccb599c-82e0-4611-a0a2-f0fb5b7ae5f0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:22 devstack sudo[125788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd Jun 20 00:05:22 devstack sudo[125788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:23 devstack sudo[125788]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd" returned: 0 in 0.942s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:23 devstack sudo[125824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 Jun 20 00:05:23 devstack sudo[125824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Flow 'volume_create_manager' (3213820f-6517-4203-9bdc-03595331fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df65a0f6-416b-485c-aff6-606f6a580f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df65a0f6-416b-485c-aff6-606f6a580f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-194622406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5d8d88-af24-4176-90c2-0d8d805f0e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfcc8a941454bf99aff773ecbeeb8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:24Z,use_quota=True,user_id='8022ff2d2526403598a10ed4f9ddca34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbe1402-30bd-424f-baa0-4becae2581f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbe1402-30bd-424f-baa0-4becae2581f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c78533-46db-4dad-94a4-1d9fdf1089ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:23 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:05:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c78533-46db-4dad-94a4-1d9fdf1089ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc5d8d88-af24-4176-90c2-0d8d805f0e62', 'volume_name': 'volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:24 devstack sudo[125824]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29c147c-f1e9-4a32-81b0-28e1c1cf70f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29c147c-f1e9-4a32-81b0-28e1c1cf70f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb917db8-1444-494a-845e-7996ac5907ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:24 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Volume bc5d8d88-af24-4176-90c2-0d8d805f0e62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 20 00:05:24 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Trying to clone bc5d8d88-af24-4176-90c2-0d8d805f0e62 from image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:05:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517" returned: 0 in 1.320s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:24 devstack sudo[125869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517 Jun 20 00:05:24 devstack sudo[125869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:25 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:05:25 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Image download 20.69 MB at 20.69 MB/s Jun 20 00:05:25 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93bdf13-bdbc-422c-b083-db4cf0d877f0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:25 devstack sudo[125888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD Jun 20 00:05:25 devstack sudo[125888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:25 devstack sudo[125869]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd.cdf7f658-79c9-4562-b096-89c513530517" returned: 0 in 1.002s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:25 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-quobyte-cdf7f658-79c9-4562-b096-89c513530517" released by "_delete_snapshot" :: held 4.348s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:25 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-quobyte-08fdf4cc-35cd-4a1f-9003-a432e07698dd" released by "delete_snapshot" :: held 4.383s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:25 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Created reservations ['c51eb895-02a1-4986-a606-4a71b0f96133', 'd44ae5cf-0d18-445a-9b20-c40272b35871', 'b6d34fa8-ac68-4130-83d0-50cc5bc427f8', 'b1c1cc07-3e24-4756-b37a-665ff5111681'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:05:25 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Delete snapshot completed successfully. Jun 20 00:05:25 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-56d4025c-6f2c-4765-a5c0-7ee55dd83ae1 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-cdf7f658-79c9-4562-b096-89c513530517-delete_snapshot" released by "delete_snapshot" :: held 4.612s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:26 devstack sudo[125888]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:26 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Temporary image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec is fetched for user 8022ff2d2526403598a10ed4f9ddca34. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:05:26 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e1f66a-1f9e-47a2-99e5-0fe58a092c89]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:26 devstack sudo[125925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD Jun 20 00:05:26 devstack sudo[125925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "cinder-08fdf4cc-35cd-4a1f-9003-a432e07698dd-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-08fdf4cc-35cd-4a1f-9003-a432e07698dd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "cinder-quobyte-08fdf4cc-35cd-4a1f-9003-a432e07698dd" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-quobyte-08fdf4cc-35cd-4a1f-9003-a432e07698dd" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49d01ab-db47-4758-9836-cb89aadef2a6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:27 devstack sudo[125955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd Jun 20 00:05:27 devstack sudo[125955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:27 devstack sudo[125925]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD" returned: 0 in 1.133s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-194622406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5d8d88-af24-4176-90c2-0d8d805f0e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfcc8a941454bf99aff773ecbeeb8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:24Z,use_quota=True,user_id='8022ff2d2526403598a10ed4f9ddca34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Creating volume bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:05:27 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:05:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:27 devstack sudo[125965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 1073741824 Jun 20 00:05:27 devstack sudo[125965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:28 devstack sudo[125997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:05:28 devstack sudo[125997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:28 devstack sudo[125955]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd" returned: 0 in 1.240s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:28 devstack sudo[126006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd Jun 20 00:05:28 devstack sudo[126006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:28 devstack sudo[125965]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 1073741824" returned: 0 in 1.198s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:28 devstack sudo[126017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:05:28 devstack sudo[126017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:29 devstack sudo[126006]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-08fdf4cc-35cd-4a1f-9003-a432e07698dd" returned: 0 in 0.906s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:29 devstack sudo[125997]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.173s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-quobyte-08fdf4cc-35cd-4a1f-9003-a432e07698dd" released by "delete_volume" :: held 2.245s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Created reservations ['42b2207d-b536-4352-bbca-274d6215306c', 'a50578a3-34b0-4499-93bb-18a5caf808ae', '7d89c2db-a553-40b1-b9cc-e77be1ed3097', '8fba115f-b989-4310-94ad-fd34da1c52d9'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:29 devstack sudo[126045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:05:29 devstack sudo[126045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:29 devstack sudo[126017]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 0 in 1.227s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] <== create_volume: return (2501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.506s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Attempting download of 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec ((None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}])) to volume bc5d8d88-af24-4176-90c2-0d8d805f0e62. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a05faf5-bd30-43c5-80ce-eef18258e2c6]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_cre2ayoq {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:30 devstack sudo[126063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_cre2ayoq Jun 20 00:05:30 devstack sudo[126063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:30 devstack sudo[126045]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.017s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:30 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:05:30 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Deleted volume successfully. Jun 20 00:05:30 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-68c290e1-3967-44f9-ad99-ac872abb6e53 tempest-VolumesSnapshotNegativeTestJSON-1489790662 None] Lock "cinder-08fdf4cc-35cd-4a1f-9003-a432e07698dd-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:31 devstack sudo[126063]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_cre2ayoq" returned: 0 in 1.231s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_cre2ayoq {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:31 devstack sudo[126104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_cre2ayoq Jun 20 00:05:31 devstack sudo[126104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:32 devstack sudo[126104]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_cre2ayoq" returned: 1 in 0.993s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_cre2ayoq' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:05:32 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ce11b6-6524-4c60-92b2-30a3cc6aa2f0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:32 devstack sudo[126138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD Jun 20 00:05:32 devstack sudo[126138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-22138dd2-98eb-4c45-944d-fe13bb766a80 tempest-GroupsV314Test-1733952172 None] Group tempest-GroupsV314Test-Group-822389556: creating Jun 20 00:05:33 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-22138dd2-98eb-4c45-944d-fe13bb766a80 tempest-GroupsV314Test-1733952172 None] Group tempest-GroupsV314Test-Group-822389556: created successfully Jun 20 00:05:33 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-22138dd2-98eb-4c45-944d-fe13bb766a80 tempest-GroupsV314Test-1733952172 None] Create group completed successfully. Jun 20 00:05:33 devstack sudo[126138]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD" returned: 0 in 0.995s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:33 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec was qcow2, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:05:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:33 devstack sudo[126174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:05:33 devstack sudo[126174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Flow 'volume_create_manager' (480aa0f4-6abd-469d-94a2-972f4e858f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e876d85-ad65-43c0-bb8b-ce89f6b1aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e876d85-ad65-43c0-bb8b-ce89f6b1aba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1939915699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30a22fce-edac-4a64-9072-3c90b0432a09,host='devstack@QuobyteHD#QuobyteHD',id=2ee7e37d-b3d2-4190-9098-5d46b9aef3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f292f08cb44c4a47e27f36d0dea79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:35Z,use_quota=True,user_id='1e20e4c7b01740bda644aa584158fcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ee59209-a74e-4a52-a2a0-ab48753dd43c),volume_type_id=2ee59209-a74e-4a52-a2a0-ab48753dd43c)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532f6812-a172-4c0e-a073-513c6d6c9042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (532f6812-a172-4c0e-a073-513c6d6c9042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56a3bdd-8478-49f3-a3e1-a370adbf07de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56a3bdd-8478-49f3-a3e1-a370adbf07de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee7e37d-b3d2-4190-9098-5d46b9aef3ad', 'volume_name': 'volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bbceb1-208d-4827-958b-123f5ce213ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37bbceb1-208d-4827-958b-123f5ce213ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2820c7-a792-4446-8da8-aac77da8e42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:35 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Volume 2ee7e37d-b3d2-4190-9098-5d46b9aef3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad', 'volume_size': 1} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=30a22fce-edac-4a64-9072-3c90b0432a09,created_at=2026-06-19T22:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1939915699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=30a22fce-edac-4a64-9072-3c90b0432a09,host='devstack@QuobyteHD#QuobyteHD',id=2ee7e37d-b3d2-4190-9098-5d46b9aef3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6f292f08cb44c4a47e27f36d0dea79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:35Z,use_quota=True,user_id='1e20e4c7b01740bda644aa584158fcc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ee59209-a74e-4a52-a2a0-ab48753dd43c),volume_type_id=2ee59209-a74e-4a52-a2a0-ab48753dd43c)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Creating volume 2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:05:35 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:35 devstack sudo[126246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad 1073741824 Jun 20 00:05:35 devstack sudo[126246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:35 devstack sudo[126174]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 0 in 2.779s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_8eoyx92edevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:05:35 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Converted 112.00 MB image at 40.24 MB/s Jun 20 00:05:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:35 devstack sudo[126269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 1G Jun 20 00:05:35 devstack sudo[126269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad 1073741824" returned: 0 in 1.295s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:36 devstack sudo[126246]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:36 devstack sudo[126295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad Jun 20 00:05:36 devstack sudo[126295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:37 devstack sudo[126269]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 1G" returned: 0 in 1.170s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[317af3bb-5408-4735-b565-48d9b8e468e0]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:37 devstack sudo[126316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:05:37 devstack sudo[126316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:37 devstack sudo[126295]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" returned: 0 in 0.855s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2820c7-a792-4446-8da8-aac77da8e42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab1cfc8-340b-45a8-a237-849508bea2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Volume volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad (2ee7e37d-b3d2-4190-9098-5d46b9aef3ad): created successfully Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab1cfc8-340b-45a8-a237-849508bea2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Flow 'volume_create_manager' (480aa0f4-6abd-469d-94a2-972f4e858f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:37 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3faa6a60-b696-49dc-9281-adb2fd4a29de tempest-GroupsV314Test-1733952172 None] Created volume successfully. Jun 20 00:05:38 devstack sudo[126316]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 0 in 0.921s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:38 devstack sudo[126348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:05:38 devstack sudo[126348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:39 devstack sudo[126348]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 1 in 1.132s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Downloaded image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec ((None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}])) to volume bc5d8d88-af24-4176-90c2-0d8d805f0e62 successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Temporary image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec for user 8022ff2d2526403598a10ed4f9ddca34 is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Marking volume bc5d8d88-af24-4176-90c2-0d8d805f0e62 as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Copying metadata from image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec to bc5d8d88-af24-4176-90c2-0d8d805f0e62. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Creating volume glance metadata for volume bc5d8d88-af24-4176-90c2-0d8d805f0e62 backed by image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb917db8-1444-494a-845e-7996ac5907ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232ddf01-ed88-43fd-b727-43b434464f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:39 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Volume volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 (bc5d8d88-af24-4176-90c2-0d8d805f0e62): created successfully Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232ddf01-ed88-43fd-b727-43b434464f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Flow 'volume_create_manager' (3213820f-6517-4203-9bdc-03595331fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1451669b-fc6b-469f-95b1-b6d31570a4e6 tempest-VolumesExtendTest-1469156154 None] Created volume successfully. Jun 20 00:05:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:40 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Cloning volume 2ee7e37d-b3d2-4190-9098-5d46b9aef3ad to volume e7f24468-91d4-4204-96ad-1c471e7ccf67 Jun 20 00:05:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Creating offline snapshot f8c49f10-4f0e-4bba-821e-3a51f4d81e1c of volume 2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:05:40 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[985fdf7f-f34d-46f6-9c9d-9f7284f86f0e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:40 devstack sudo[126416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad Jun 20 00:05:40 devstack sudo[126416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:41 devstack sudo[126416]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" returned: 0 in 0.984s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:41 devstack sudo[126451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c 1G Jun 20 00:05:41 devstack sudo[126451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:42 devstack sudo[126451]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c 1G" returned: 0 in 1.035s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:42 devstack sudo[126488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c Jun 20 00:05:42 devstack sudo[126488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:43 devstack sudo[126488]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" returned: 0 in 0.910s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:43 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:05:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:43 devstack sudo[126520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c Jun 20 00:05:43 devstack sudo[126520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:43 devstack sudo[126520]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" returned: 0 in 0.791s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:43 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=121,cinder:SELECT=97,cinder:INSERT=35,cinder:DELETE=7 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:05:43 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=119,cinder:SELECT=112,cinder:INSERT=39,cinder:DELETE=9 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:05:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:44 devstack sudo[126550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.info Jun 20 00:05:44 devstack sudo[126550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:44 devstack sudo[126550]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.info" returned: 0 in 0.835s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:44 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.info is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:05:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:44 devstack sudo[126577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.info Jun 20 00:05:44 devstack sudo[126577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:45 devstack sudo[126577]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.info" returned: 0 in 0.821s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Acquiring lock "cinder-quobyte-e7f24468-91d4-4204-96ad-1c471e7ccf67" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Lock "cinder-quobyte-e7f24468-91d4-4204-96ad-1c471e7ccf67" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] snapshot: f8c49f10-4f0e-4bba-821e-3a51f4d81e1c, volume: e7f24468-91d4-4204-96ad-1c471e7ccf67, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8823808e-1b06-4eb6-918f-619861142a27]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:45 devstack sudo[126608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c Jun 20 00:05:45 devstack sudo[126608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:46 devstack sudo[126608]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" returned: 0 in 1.024s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:05:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:05:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:05:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[941b5983-edef-41f2-9186-ed971d36939a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:46 devstack sudo[126644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad Jun 20 00:05:46 devstack sudo[126644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:47 devstack sudo[126644]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" returned: 0 in 1.017s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:47 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:05:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:47 devstack sudo[126681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 Jun 20 00:05:47 devstack sudo[126681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:54 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:05:54 devstack sudo[126681]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67" returned: 0 in 6.428s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d242edee-3252-41ef-9f0a-e1838923ca9a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:54 devstack sudo[126883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad Jun 20 00:05:54 devstack sudo[126883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Flow 'volume_create_manager' (83c6d9a9-f561-4c17-a411-ee50d1711275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ef2c16-5706-45e4-b482-8031a37a2f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ef2c16-5706-45e4-b482-8031a37a2f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1700170438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e481d90b-684a-4094-9154-0c3b744981e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f474438d6d77410d9cc8f15327600786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:55Z,use_quota=True,user_id='fdaf97161abb41c8baf9029e0c115be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e261d443-1e97-490e-93a5-baf5a7553b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e261d443-1e97-490e-93a5-baf5a7553b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa94205-f5be-49e2-ab41-bcbdb00aee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:05:55 devstack sudo[126883]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" returned: 0 in 1.119s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:05:55 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Converted 1024.00 MB image at 159.26 MB/s Jun 20 00:05:55 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 is being set with open permissions: ugo+rw: NotImplementedError Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:55 devstack sudo[126922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 Jun 20 00:05:55 devstack sudo[126922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa94205-f5be-49e2-ab41-bcbdb00aee0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e481d90b-684a-4094-9154-0c3b744981e3', 'volume_name': 'volume-e481d90b-684a-4094-9154-0c3b744981e3', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751b73a6-0ab4-442b-82f0-90141e9a5a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751b73a6-0ab4-442b-82f0-90141e9a5a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4944439-37ba-4722-b739-604f5780ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:05:55 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Volume e481d90b-684a-4094-9154-0c3b744981e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e481d90b-684a-4094-9154-0c3b744981e3', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Trying to clone e481d90b-684a-4094-9154-0c3b744981e3 from image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:05:55 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Image download 20.69 MB at 20.69 MB/s Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc81921-7a9c-484e-9db3-029ffd076384]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:56 devstack sudo[126922]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67" returned: 0 in 0.696s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:56 devstack sudo[126944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD Jun 20 00:05:56 devstack sudo[126944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Lock "cinder-quobyte-e7f24468-91d4-4204-96ad-1c471e7ccf67" released by "_copy_volume_from_snapshot" :: held 10.397s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Acquiring lock "cinder-quobyte-f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Lock "cinder-quobyte-f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Deleting offline snapshot f8c49f10-4f0e-4bba-821e-3a51f4d81e1c of volume 2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] snapshot_file for this snap is: volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7ea836-9ca5-4571-8a59-665034c72858]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:56 devstack sudo[126952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c Jun 20 00:05:56 devstack sudo[126952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:56 devstack sudo[126944]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Temporary image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec is fetched for user fdaf97161abb41c8baf9029e0c115be3. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b68677-2a8f-4e34-8e4a-7e4ce3bec3b1]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:57 devstack sudo[126979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD Jun 20 00:05:57 devstack sudo[126979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:57 devstack sudo[126952]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" returned: 0 in 0.919s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:05:57 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc8bd65-f683-456a-a41f-61d775ffda84]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:57 devstack sudo[126993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad Jun 20 00:05:57 devstack sudo[126993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:57 devstack sudo[126979]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD" returned: 0 in 0.990s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:05:58 devstack sudo[126993]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" returned: 0 in 1.017s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:58 devstack sudo[127032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c Jun 20 00:05:58 devstack sudo[127032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:59 devstack sudo[127032]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" returned: 0 in 0.919s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:59 devstack sudo[127071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c Jun 20 00:05:59 devstack sudo[127071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:05:59 devstack sudo[127071]: pam_unix(sudo:session): session closed for user root Jun 20 00:05:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad.f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" returned: 0 in 0.660s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:05:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Lock "cinder-quobyte-f8c49f10-4f0e-4bba-821e-3a51f4d81e1c" released by "_delete_snapshot" :: held 3.645s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:05:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.684s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:05:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 19.471s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:05:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a62c0e4-c156-4a16-bb8d-7f022f0c1866]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:05:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:05:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ca6d274b-d494-4c8e-954c-1bb7ad3b4297 tempest-GroupsV314Test-1733952172 None] Create group from source-group-30a22fce-edac-4a64-9072-3c90b0432a09 completed successfully. Jun 20 00:05:59 devstack sudo[127095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:05:59 devstack sudo[127095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Acquiring lock "cinder-quobyte-e7f24468-91d4-4204-96ad-1c471e7ccf67" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Lock "cinder-quobyte-e7f24468-91d4-4204-96ad-1c471e7ccf67" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46f32bb-62c7-427f-82f9-6bdb9d83b80e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:00 devstack sudo[127095]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 0 in 1.096s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:00 devstack sudo[127128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 Jun 20 00:06:00 devstack sudo[127128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:01 devstack sudo[127133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:06:01 devstack sudo[127133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:01 devstack sudo[127128]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67" returned: 0 in 1.104s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:01 devstack sudo[127168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67 Jun 20 00:06:01 devstack sudo[127168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:02 devstack sudo[127133]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 1 in 1.139s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 2G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 2G" returned: 0 in 0.062s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.353s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.252s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1700170438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e481d90b-684a-4094-9154-0c3b744981e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f474438d6d77410d9cc8f15327600786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:05:55Z,use_quota=True,user_id='fdaf97161abb41c8baf9029e0c115be3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Creating volume e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:02 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:02 devstack sudo[127185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 1073741824 Jun 20 00:06:02 devstack sudo[127185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c5b1f576-7518-4ec5-81da-6f8c8f7b8d4d tempest-VolumesExtendTest-1469156154 None] Extend volume completed successfully. Jun 20 00:06:02 devstack sudo[127168]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e7f24468-91d4-4204-96ad-1c471e7ccf67" returned: 0 in 0.710s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Lock "cinder-quobyte-e7f24468-91d4-4204-96ad-1c471e7ccf67" released by "delete_volume" :: held 1.884s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Created reservations ['8b5d3780-abb0-4fb3-b9e5-de01684b14ef'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:06:02 devstack cinder-volume[93391]: WARNING cinder.quota [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1490853254 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1490853254, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:06:02 devstack cinder-volume[93391]: WARNING cinder.quota [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1490853254 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1490853254, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Created reservations ['6f5a0188-f9c0-4027-9060-71bce798bb39', 'b382c828-37e0-47f3-8e8d-0ee1a539623d', '42fbb698-e748-4663-9a61-0bf1461a9db5', '7f73f15e-cc3c-43eb-8f6a-c19fd6e17586'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:02 devstack sudo[127213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:06:02 devstack sudo[127213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:02 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Flow 'volume_create_manager' (4e96a209-90c2-4ec2-aa76-8eb4435dc932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05f4364-2169-490b-b63a-b9403b7a6911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05f4364-2169-490b-b63a-b9403b7a6911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1082631470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d2397-ae4a-4d18-95ec-768339931671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9ea2549b784bc2ba0e5901b8558e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:03Z,use_quota=True,user_id='4ec5522e8e6e44378f23fd181bdf4333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f711752-7da0-4a6d-8e7f-e6da91802c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f711752-7da0-4a6d-8e7f-e6da91802c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe8b9e7-7a4d-4313-8071-bebb0daa9091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe8b9e7-7a4d-4313-8071-bebb0daa9091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6d2397-ae4a-4d18-95ec-768339931671', 'volume_name': 'volume-cf6d2397-ae4a-4d18-95ec-768339931671', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f51e81-c6aa-4b46-a3a9-8c0542635f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f51e81-c6aa-4b46-a3a9-8c0542635f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46977d5d-a0a8-4ed0-8e9c-ea162a1c7836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Volume cf6d2397-ae4a-4d18-95ec-768339931671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6d2397-ae4a-4d18-95ec-768339931671', 'volume_size': 1} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Acquiring lock "cinder-bc5d8d88-af24-4176-90c2-0d8d805f0e62-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Lock "cinder-bc5d8d88-af24-4176-90c2-0d8d805f0e62-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Acquiring lock "cinder-quobyte-bc5d8d88-af24-4176-90c2-0d8d805f0e62" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Lock "cinder-quobyte-bc5d8d88-af24-4176-90c2-0d8d805f0e62" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e927e5e-2801-4aad-b14f-f38f4f8ee0fd]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:03 devstack sudo[127227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:06:03 devstack sudo[127227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:03 devstack sudo[127185]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 1073741824" returned: 0 in 1.463s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Flow 'volume_create_manager' (0ecd61d9-3954-4424-b949-00a0e0688df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eded4667-2f3c-4f81-a6b2-dbdd56985cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Acquiring lock "cinder-quobyte-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eded4667-2f3c-4f81-a6b2-dbdd56985cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1351331940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65f7fad-1e02-4b59-8028-00aeab8753ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9ea2549b784bc2ba0e5901b8558e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:04Z,use_quota=True,user_id='4ec5522e8e6e44378f23fd181bdf4333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4b58ff-29f4-4186-9a7f-c18f2e29e97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d4b58ff-29f4-4186-9a7f-c18f2e29e97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad33551b-8cc8-4f02-91de-b2111bdcd060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad33551b-8cc8-4f02-91de-b2111bdcd060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65f7fad-1e02-4b59-8028-00aeab8753ec', 'volume_name': 'volume-b65f7fad-1e02-4b59-8028-00aeab8753ec', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c361f2-6e91-4f3b-8e88-aa13feb980d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c361f2-6e91-4f3b-8e88-aa13feb980d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc66220-3550-4246-927c-f2b59e0fcf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:03 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Volume b65f7fad-1e02-4b59-8028-00aeab8753ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65f7fad-1e02-4b59-8028-00aeab8753ec', 'volume_size': 1} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Lock "cinder-quobyte-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" acquired by "delete_volume" :: waited 0.148s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffbd80a-9d84-4f4f-93c1-e18e19d84514]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:03 devstack sudo[127213]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.034s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:03 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:06:03 devstack sudo[127248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:06:03 devstack sudo[127248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f42596e7-79bb-41d8-a690-3e4397610ae8 tempest-GroupsV314Test-1733952172 None] Delete group completed successfully. Jun 20 00:06:04 devstack sudo[127249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad Jun 20 00:06:04 devstack sudo[127249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:04 devstack sudo[127227]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 0 in 1.270s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:04 devstack sudo[127273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:06:04 devstack sudo[127273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:04 devstack sudo[127248]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 0 in 0.849s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1082631470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d2397-ae4a-4d18-95ec-768339931671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9ea2549b784bc2ba0e5901b8558e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:03Z,use_quota=True,user_id='4ec5522e8e6e44378f23fd181bdf4333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Creating volume cf6d2397-ae4a-4d18-95ec-768339931671 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:04 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:04 devstack sudo[127284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 1073741824 Jun 20 00:06:04 devstack sudo[127284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Attempting download of 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec ((None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}])) to volume e481d90b-684a-4094-9154-0c3b744981e3. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3043db-d46e-46b6-8247-f347fdb23cdc]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_zsacdyzv {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:05 devstack sudo[127249]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" returned: 0 in 1.105s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:05 devstack sudo[127297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad Jun 20 00:06:05 devstack sudo[127297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:05 devstack sudo[127293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_zsacdyzv Jun 20 00:06:05 devstack sudo[127293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:05 devstack sudo[127273]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 1 in 1.244s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:06:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:05 devstack sudo[127332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62 Jun 20 00:06:05 devstack sudo[127332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:05 devstack sudo[127293]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_zsacdyzv" returned: 0 in 1.028s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_zsacdyzv {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:06 devstack sudo[127284]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 1073741824" returned: 0 in 1.274s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:06 devstack sudo[127339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_zsacdyzv Jun 20 00:06:06 devstack sudo[127339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:06 devstack sudo[127346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 Jun 20 00:06:06 devstack sudo[127297]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:06 devstack sudo[127346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" returned: 0 in 1.144s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Lock "cinder-quobyte-2ee7e37d-b3d2-4190-9098-5d46b9aef3ad" released by "delete_volume" :: held 2.371s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Created reservations ['9632cbc2-083d-4aac-9859-b56d4355d915'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Created reservations ['b44f3ce0-5fa7-41d6-ae6e-6675478b7993', '4a89f138-502a-4386-b6d5-81d7f02906a3', '1894ce5a-269f-4ab3-b995-8eb0a4907309', 'b6eabcc9-cf20-4f41-9312-5214bf576920'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:06 devstack sudo[127364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:06:06 devstack sudo[127364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:06 devstack sudo[127339]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_zsacdyzv" returned: 1 in 1.012s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_zsacdyzv' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedb40ef-e9ae-4271-8122-8994eb9d3d29]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:07 devstack sudo[127332]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bc5d8d88-af24-4176-90c2-0d8d805f0e62" returned: 0 in 1.181s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Lock "cinder-quobyte-bc5d8d88-af24-4176-90c2-0d8d805f0e62" released by "delete_volume" :: held 3.813s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Created reservations ['eb8e3035-c4a8-4591-aa07-3b5a99299f8d', '4d1e4dc4-2327-4a4c-86e4-3128074f413e', '58779172-34b9-462e-a619-edcaebe4da94', '098ff599-677a-43f6-8a5f-315511840c85'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:06:07 devstack sudo[127378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD Jun 20 00:06:07 devstack sudo[127378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:07 devstack sudo[127346]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671" returned: 0 in 1.232s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.601s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.570s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1351331940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65f7fad-1e02-4b59-8028-00aeab8753ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c9ea2549b784bc2ba0e5901b8558e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:04Z,use_quota=True,user_id='4ec5522e8e6e44378f23fd181bdf4333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Creating volume b65f7fad-1e02-4b59-8028-00aeab8753ec {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:07 devstack sudo[127390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:06:07 devstack sudo[127390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:07 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46977d5d-a0a8-4ed0-8e9c-ea162a1c7836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6d2397-ae4a-4d18-95ec-768339931671', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:07 devstack sudo[127396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec 1073741824 Jun 20 00:06:07 devstack sudo[127396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5b1919-e598-4049-8649-ce35f3d6e2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:07 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Volume volume-cf6d2397-ae4a-4d18-95ec-768339931671 (cf6d2397-ae4a-4d18-95ec-768339931671): created successfully Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5b1919-e598-4049-8649-ce35f3d6e2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Flow 'volume_create_manager' (4e96a209-90c2-4ec2-aa76-8eb4435dc932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1b8519cb-01a8-4162-b9ae-02d4a831a34b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Created volume successfully. Jun 20 00:06:07 devstack sudo[127364]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.159s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:07 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:06:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-224c1471-bcd4-4704-8a46-6d1da26be523 tempest-GroupsV314Test-1733952172 None] Delete group completed successfully. Jun 20 00:06:08 devstack sudo[127390]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.964s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:08 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:06:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Deleted volume successfully. Jun 20 00:06:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c7b1b058-17a3-4844-808a-c982a032a5ad tempest-VolumesExtendTest-1469156154 None] Lock "cinder-bc5d8d88-af24-4176-90c2-0d8d805f0e62-delete_volume" released by "delete_volume" :: held 5.178s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:08 devstack sudo[127378]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD" returned: 0 in 1.426s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:08 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec was qcow2, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:06:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:08 devstack sudo[127436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:06:08 devstack sudo[127436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Flow 'volume_create_manager' (55bff5c3-a1de-486e-b62b-087c265f08f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52d593d-6c5e-4114-a070-d5b6f1d9b101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52d593d-6c5e-4114-a070-d5b6f1d9b101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-963543143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3b1370-834d-458c-82e9-1ec82c75dcc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfcc8a941454bf99aff773ecbeeb8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:09Z,use_quota=True,user_id='8022ff2d2526403598a10ed4f9ddca34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f9b858-55b5-4f63-b459-8bb21e2e18ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8f9b858-55b5-4f63-b459-8bb21e2e18ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043b1bd3-f25d-4b55-9a35-394509e0864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043b1bd3-f25d-4b55-9a35-394509e0864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e3b1370-834d-458c-82e9-1ec82c75dcc7', 'volume_name': 'volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bb277b-0200-40b8-9d12-0b91ddea010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bb277b-0200-40b8-9d12-0b91ddea010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ce76ea-f281-407b-a429-4482dba69ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:09 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Volume 8e3b1370-834d-458c-82e9-1ec82c75dcc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7', 'volume_size': 1} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:09 devstack sudo[127396]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec 1073741824" returned: 0 in 1.879s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:09 devstack sudo[127469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec Jun 20 00:06:09 devstack sudo[127469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:10 devstack sudo[127469]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec" returned: 0 in 0.889s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] <== create_volume: return (2820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.826s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.996s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-963543143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e3b1370-834d-458c-82e9-1ec82c75dcc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfcc8a941454bf99aff773ecbeeb8d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:09Z,use_quota=True,user_id='8022ff2d2526403598a10ed4f9ddca34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Creating volume 8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:10 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:10 devstack sudo[127511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 1073741824 Jun 20 00:06:10 devstack sudo[127511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc66220-3550-4246-927c-f2b59e0fcf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65f7fad-1e02-4b59-8028-00aeab8753ec', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e024cc29-d6a1-415d-b5d3-c989f6328e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:10 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Volume volume-b65f7fad-1e02-4b59-8028-00aeab8753ec (b65f7fad-1e02-4b59-8028-00aeab8753ec): created successfully Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e024cc29-d6a1-415d-b5d3-c989f6328e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Flow 'volume_create_manager' (0ecd61d9-3954-4424-b949-00a0e0688df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:10 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6b5247a8-6532-4694-86ba-bfd63c77845b tempest-TestServerVolumeAttachmentScenario-1487688788 None] Created volume successfully. Jun 20 00:06:11 devstack sudo[127511]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 1073741824" returned: 0 in 1.256s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:11 devstack sudo[127436]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 0 in 3.103s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:11 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_4fqcna9ydevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:06:11 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Converted 112.00 MB image at 36.07 MB/s Jun 20 00:06:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:11 devstack sudo[127556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 Jun 20 00:06:11 devstack sudo[127556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:11 devstack sudo[127557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 1G Jun 20 00:06:11 devstack sudo[127557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:12 devstack sudo[127556]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7" returned: 0 in 0.886s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] <== create_volume: return (2202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:12 devstack sudo[127557]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 1G" returned: 0 in 0.879s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ce76ea-f281-407b-a429-4482dba69ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d89d11a-0c67-411f-a848-14bf240adf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:12 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Volume volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 (8e3b1370-834d-458c-82e9-1ec82c75dcc7): created successfully Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d89d11a-0c67-411f-a848-14bf240adf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Flow 'volume_create_manager' (55bff5c3-a1de-486e-b62b-087c265f08f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[424c1696-52f3-469e-8ad5-b6fad07baa81]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:12 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c05d2dd7-a133-4d49-a828-b83cd2679e61 tempest-VolumesExtendTest-1469156154 None] Created volume successfully. Jun 20 00:06:12 devstack sudo[127593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:06:12 devstack sudo[127593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:13 devstack sudo[127593]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 0 in 0.856s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Creating offline snapshot c02fa2af-54de-45ee-8402-031caf726177 of volume 8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:06:13 devstack sudo[127624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:06:13 devstack sudo[127624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:13 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[226ee23c-4fa2-44b5-a188-21ad4c54594a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:13 devstack sudo[127629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 Jun 20 00:06:13 devstack sudo[127629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:14 devstack sudo[127624]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 1 in 0.843s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Downloaded image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec ((None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}])) to volume e481d90b-684a-4094-9154-0c3b744981e3 successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Temporary image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec for user fdaf97161abb41c8baf9029e0c115be3 is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Marking volume e481d90b-684a-4094-9154-0c3b744981e3 as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Copying metadata from image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec to e481d90b-684a-4094-9154-0c3b744981e3. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Creating volume glance metadata for volume e481d90b-684a-4094-9154-0c3b744981e3 backed by image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4944439-37ba-4722-b739-604f5780ae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e481d90b-684a-4094-9154-0c3b744981e3', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfb1830-09d3-45e0-9267-06bf70e47bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:14 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Volume volume-e481d90b-684a-4094-9154-0c3b744981e3 (e481d90b-684a-4094-9154-0c3b744981e3): created successfully Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bfb1830-09d3-45e0-9267-06bf70e47bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Flow 'volume_create_manager' (83c6d9a9-f561-4c17-a411-ee50d1711275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-dc452129-aa7a-4684-8ab7-9e8e7ff80aca tempest-TestShelveInstance-855873225 None] Created volume successfully. Jun 20 00:06:14 devstack sudo[127629]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7" returned: 0 in 0.992s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:14 devstack sudo[127669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 1G Jun 20 00:06:14 devstack sudo[127669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:15 devstack sudo[127669]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 1G" returned: 0 in 1.212s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:15 devstack sudo[127711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 Jun 20 00:06:15 devstack sudo[127711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:17 devstack sudo[127711]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177" returned: 0 in 1.315s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:17 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 is being set with open permissions: ugo+rw Jun 20 00:06:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:17 devstack sudo[127803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 Jun 20 00:06:17 devstack sudo[127803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:17 devstack sudo[127803]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177" returned: 0 in 0.942s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:18 devstack sudo[127846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.info Jun 20 00:06:18 devstack sudo[127846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:18 devstack sudo[127846]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.info" returned: 0 in 0.770s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:18 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.info is being set with open permissions: ugo+rw Jun 20 00:06:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:18 devstack sudo[127872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.info Jun 20 00:06:18 devstack sudo[127872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:19 devstack sudo[127872]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.info" returned: 0 in 0.733s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.070s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:19 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ae8b3929-0147-4efa-9f3d-510e48bc672c tempest-VolumesExtendTest-1469156154 None] Create snapshot completed successfully Jun 20 00:06:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c576cd22-b6aa-4518-b663-eae28b1121aa tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c576cd22-b6aa-4518-b663-eae28b1121aa tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:20 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d84ca9-26c9-4ff2-87d8-857124d9723f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c576cd22-b6aa-4518-b663-eae28b1121aa tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:20 devstack sudo[127912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 Jun 20 00:06:20 devstack sudo[127912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:20 devstack sudo[127912]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c576cd22-b6aa-4518-b663-eae28b1121aa tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7" returned: 0 in 0.847s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c576cd22-b6aa-4518-b663-eae28b1121aa tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 2G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c576cd22-b6aa-4518-b663-eae28b1121aa tempest-VolumesExtendTest-1469156154 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 2G" returned: 0 in 0.138s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c576cd22-b6aa-4518-b663-eae28b1121aa tempest-VolumesExtendTest-1469156154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.042s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c576cd22-b6aa-4518-b663-eae28b1121aa tempest-VolumesExtendTest-1469156154 None] Extend volume completed successfully. Jun 20 00:06:21 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:06:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Flow 'volume_create_manager' (8c62f6ae-5af3-4968-81e4-f63471fb6f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2257ac3b-f825-4b8d-b7a9-f02b2cf8d9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2257ac3b-f825-4b8d-b7a9-f02b2cf8d9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-876572635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f7a305-762d-4f67-92a0-b9800bf003e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8bcfde1ad854a349346b79c1299fb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:22Z,use_quota=True,user_id='d8485cb033fc4ea4935e3f99c6e52d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da45e58-85fd-47e4-b461-59a6ca182562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da45e58-85fd-47e4-b461-59a6ca182562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196b931a-df36-4556-b302-95d312009f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196b931a-df36-4556-b302-95d312009f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7f7a305-762d-4f67-92a0-b9800bf003e7', 'volume_name': 'volume-c7f7a305-762d-4f67-92a0-b9800bf003e7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14c0440-b8a2-4e30-8dff-17c57be2b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14c0440-b8a2-4e30-8dff-17c57be2b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0bb51c-9cfe-43ee-a03b-fcbc3b74ac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:22 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Volume c7f7a305-762d-4f67-92a0-b9800bf003e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7f7a305-762d-4f67-92a0-b9800bf003e7', 'volume_size': 1} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-876572635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f7a305-762d-4f67-92a0-b9800bf003e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8bcfde1ad854a349346b79c1299fb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:22Z,use_quota=True,user_id='d8485cb033fc4ea4935e3f99c6e52d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Creating volume c7f7a305-762d-4f67-92a0-b9800bf003e7 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:22 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:22 devstack sudo[127984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 1073741824 Jun 20 00:06:22 devstack sudo[127984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Acquiring lock "cinder-c02fa2af-54de-45ee-8402-031caf726177-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Lock "cinder-c02fa2af-54de-45ee-8402-031caf726177-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Acquiring lock "cinder-quobyte-8e3b1370-834d-458c-82e9-1ec82c75dcc7" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Lock "cinder-quobyte-8e3b1370-834d-458c-82e9-1ec82c75dcc7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Acquiring lock "cinder-quobyte-c02fa2af-54de-45ee-8402-031caf726177" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Lock "cinder-quobyte-c02fa2af-54de-45ee-8402-031caf726177" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Deleting offline snapshot c02fa2af-54de-45ee-8402-031caf726177 of volume 8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] snapshot_file for this snap is: volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05720d08-b5cf-4f2f-a89d-925a0597126e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:22 devstack sudo[127998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 Jun 20 00:06:22 devstack sudo[127998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:23 devstack sudo[127984]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 1073741824" returned: 0 in 1.362s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:23 devstack sudo[128057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 Jun 20 00:06:23 devstack sudo[128057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:23 devstack sudo[127998]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177" returned: 0 in 1.258s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:06:23 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e059d8-1d59-4ed9-8ce9-19032db3b82b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:23 devstack sudo[128069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 Jun 20 00:06:23 devstack sudo[128069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:25 devstack sudo[128057]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7" returned: 0 in 1.628s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] <== create_volume: return (3086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.093s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.416s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0bb51c-9cfe-43ee-a03b-fcbc3b74ac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f7a305-762d-4f67-92a0-b9800bf003e7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d0b9f2-7a03-4426-a99d-c65332d4aeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:25 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Volume volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 (c7f7a305-762d-4f67-92a0-b9800bf003e7): created successfully Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0d0b9f2-7a03-4426-a99d-c65332d4aeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Flow 'volume_create_manager' (8c62f6ae-5af3-4968-81e4-f63471fb6f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c116084c-3904-4197-8166-ba28cdbb3183]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:25 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b7b022a2-4601-462f-b5b6-ce9a023a1a57 tempest-VolumesServicesTestJSON-1297825827 None] Created volume successfully. Jun 20 00:06:25 devstack sudo[128069]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7" returned: 0 in 1.605s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:25 devstack sudo[128189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 Jun 20 00:06:25 devstack sudo[128189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:25 devstack sudo[128186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:06:25 devstack sudo[128186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:26 devstack sudo[128189]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177" returned: 0 in 1.013s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:26 devstack sudo[128186]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 0 in 1.084s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:26 devstack sudo[128231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177 Jun 20 00:06:26 devstack sudo[128231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:26 devstack sudo[128236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:06:26 devstack sudo[128236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Acquiring lock "cinder-c7f7a305-762d-4f67-92a0-b9800bf003e7-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Lock "cinder-c7f7a305-762d-4f67-92a0-b9800bf003e7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Acquiring lock "cinder-quobyte-c7f7a305-762d-4f67-92a0-b9800bf003e7" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Lock "cinder-quobyte-c7f7a305-762d-4f67-92a0-b9800bf003e7" acquired by "delete_volume" :: waited 0.071s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:27 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebcb03f-489d-453f-8bc5-4dba7afbd8fb]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:27 devstack sudo[128259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 Jun 20 00:06:27 devstack sudo[128259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:27 devstack sudo[128231]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7.c02fa2af-54de-45ee-8402-031caf726177" returned: 0 in 1.199s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Lock "cinder-quobyte-c02fa2af-54de-45ee-8402-031caf726177" released by "_delete_snapshot" :: held 5.237s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Lock "cinder-quobyte-8e3b1370-834d-458c-82e9-1ec82c75dcc7" released by "delete_snapshot" :: held 5.272s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:27 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Created reservations ['bfb7412d-d82b-43af-a783-740a999364cc', '9d293687-2964-4b1d-9e98-8b8475b99707', 'f9de8244-f714-4dd2-9884-15eedeac554e', '0a419a37-170b-4df8-a45a-a24a37a4ccf4'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:06:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Delete snapshot completed successfully. Jun 20 00:06:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1e033eab-87a2-41bd-8468-6e8e4f2ca223 tempest-VolumesExtendTest-1469156154 None] Lock "cinder-c02fa2af-54de-45ee-8402-031caf726177-delete_snapshot" released by "delete_snapshot" :: held 5.630s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:28 devstack sudo[128292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:06:28 devstack sudo[128292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:28 devstack sudo[128236]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 1 in 1.861s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.054s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-e481d90b-684a-4094-9154-0c3b744981e3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07e27b2f-d102-49a8-ac98-e0cac92df3b9', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:06:28 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-41c6d851-6964-4c4b-b08d-8cb73e0441fa req-3b142be5-daef-4706-92b5-e0b62e9fc541 tempest-TestShelveInstance-855873225 None] attachment_update completed successfully. Jun 20 00:06:28 devstack sudo[128259]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7" returned: 0 in 1.721s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:28 devstack sudo[128321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7 Jun 20 00:06:28 devstack sudo[128321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Acquiring lock "cinder-8e3b1370-834d-458c-82e9-1ec82c75dcc7-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Lock "cinder-8e3b1370-834d-458c-82e9-1ec82c75dcc7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Acquiring lock "cinder-quobyte-8e3b1370-834d-458c-82e9-1ec82c75dcc7" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Lock "cinder-quobyte-8e3b1370-834d-458c-82e9-1ec82c75dcc7" acquired by "delete_volume" :: waited 0.029s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:29 devstack sudo[128292]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.138s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[347888c2-3d7e-40a3-9be9-a2d1f7071f61]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:06:29 devstack sudo[128334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 Jun 20 00:06:29 devstack sudo[128334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:29 devstack sudo[128321]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c7f7a305-762d-4f67-92a0-b9800bf003e7" returned: 0 in 1.089s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Lock "cinder-quobyte-c7f7a305-762d-4f67-92a0-b9800bf003e7" released by "delete_volume" :: held 2.919s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Created reservations ['8ea48579-8e36-4eca-b0bd-1d9b173034bc', '5700309d-a551-4d49-8eab-96d3810ce4cd', '07024d54-cb17-414a-a3e8-fef3659d9f1c', '795c2427-0f1c-4411-9129-87e8783fe40f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:30 devstack sudo[128373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:06:30 devstack sudo[128373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:30 devstack sudo[128334]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7" returned: 0 in 1.326s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:30 devstack sudo[128386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7 Jun 20 00:06:30 devstack sudo[128386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:31 devstack sudo[128373]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.450s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:06:31 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Deleted volume successfully. Jun 20 00:06:31 devstack sudo[128386]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8e3b1370-834d-458c-82e9-1ec82c75dcc7" returned: 0 in 1.233s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2df6eeb0-4963-4f42-9a22-a29501ca0afe tempest-VolumesServicesTestJSON-1297825827 None] Lock "cinder-c7f7a305-762d-4f67-92a0-b9800bf003e7-delete_volume" released by "delete_volume" :: held 4.998s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Lock "cinder-quobyte-8e3b1370-834d-458c-82e9-1ec82c75dcc7" released by "delete_volume" :: held 2.694s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Created reservations ['8010569c-3613-455d-ab4b-6a06162cebe7', '743a8973-d071-4d8e-99ea-b1340db75810', '572b09c1-86fd-4a62-ba5d-a2a89ca290f0', 'cdb26960-f2c5-4ba0-af65-9dc682ac9aba'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:32 devstack sudo[128502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:06:32 devstack sudo[128502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:32 devstack sudo[128502]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.926s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:32 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:06:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Deleted volume successfully. Jun 20 00:06:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-eff1721a-e060-457e-bf25-1d8cbc5822ef tempest-VolumesExtendTest-1469156154 None] Lock "cinder-8e3b1370-834d-458c-82e9-1ec82c75dcc7-delete_volume" released by "delete_volume" :: held 4.018s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:06:37 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Flow 'volume_create_manager' (e7fd1d91-21e7-4fcc-a584-038c7efd40e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9837f566-692a-48a8-935e-26ad0ab186e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9837f566-692a-48a8-935e-26ad0ab186e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1953378282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240d3020-9a0d-43a4-91df-037384ec3e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88b840ad6644ee784392589bbc0e088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:38Z,use_quota=True,user_id='52efb4596cf54f23976c4de981777db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f435d628-dde6-498c-a703-82a7a7778ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f435d628-dde6-498c-a703-82a7a7778ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091d35e2-f597-4425-9605-d6dd6982b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091d35e2-f597-4425-9605-d6dd6982b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240d3020-9a0d-43a4-91df-037384ec3e11', 'volume_name': 'volume-240d3020-9a0d-43a4-91df-037384ec3e11', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97234db-6f8c-4cb6-b6cb-db903a23404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97234db-6f8c-4cb6-b6cb-db903a23404f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36377e62-f881-4cee-b87e-6471de94571c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:38 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Volume 240d3020-9a0d-43a4-91df-037384ec3e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240d3020-9a0d-43a4-91df-037384ec3e11', 'volume_size': 1} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1953378282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240d3020-9a0d-43a4-91df-037384ec3e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88b840ad6644ee784392589bbc0e088',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:38Z,use_quota=True,user_id='52efb4596cf54f23976c4de981777db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Creating volume 240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:38 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:38 devstack sudo[129085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 1073741824 Jun 20 00:06:38 devstack sudo[129085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:39 devstack sudo[129085]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 1073741824" returned: 0 in 1.594s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:39 devstack sudo[129181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 Jun 20 00:06:39 devstack sudo[129181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:40 devstack sudo[129181]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11" returned: 0 in 0.819s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:40 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] <== create_volume: return (2494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:06:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36377e62-f881-4cee-b87e-6471de94571c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240d3020-9a0d-43a4-91df-037384ec3e11', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50dc338-6366-4adc-921c-80f8a024bac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:40 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Volume volume-240d3020-9a0d-43a4-91df-037384ec3e11 (240d3020-9a0d-43a4-91df-037384ec3e11): created successfully Jun 20 00:06:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50dc338-6366-4adc-921c-80f8a024bac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:40 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Flow 'volume_create_manager' (e7fd1d91-21e7-4fcc-a584-038c7efd40e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:40 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7687fec8-0589-4a9f-b90f-94beced96a04 tempest-VolumesSnapshotListTestJSON-574399185 None] Created volume successfully. Jun 20 00:06:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Creating offline snapshot 585b9905-103f-428b-acf0-8defb9436844 of volume 240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:06:41 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cb11f3-48c7-433f-943e-05d9c20502b8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:41 devstack sudo[129238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 Jun 20 00:06:41 devstack sudo[129238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:43 devstack sudo[129238]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11" returned: 0 in 1.396s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:43 devstack sudo[129282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 1G Jun 20 00:06:43 devstack sudo[129282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:44 devstack sudo[129282]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 1G" returned: 0 in 1.264s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:44 devstack sudo[129328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 Jun 20 00:06:44 devstack sudo[129328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:45 devstack sudo[129328]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844" returned: 0 in 0.899s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:45 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 is being set with open permissions: ugo+rw Jun 20 00:06:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:45 devstack sudo[129363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 Jun 20 00:06:45 devstack sudo[129363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:46 devstack sudo[129363]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844" returned: 0 in 0.943s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:46 devstack sudo[129396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.info Jun 20 00:06:46 devstack sudo[129396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Flow 'volume_create_manager' (bfdf5c9a-a906-46d1-aa2c-9389945cf28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fab841-2b48-4c46-bbd3-e40745be373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fab841-2b48-4c46-bbd3-e40745be373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-672235420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2def116c-8664-439a-a55f-5ede433f8cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2856740adc2f4ca484152dfde338eb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:47Z,use_quota=True,user_id='a0f65fe638c041d0b4109181a1a9ee0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003ebd5d-2683-4b78-98af-2542860b4a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003ebd5d-2683-4b78-98af-2542860b4a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e7d1ee-f411-44f6-8d81-0718c2cf328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e7d1ee-f411-44f6-8d81-0718c2cf328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2def116c-8664-439a-a55f-5ede433f8cce', 'volume_name': 'volume-2def116c-8664-439a-a55f-5ede433f8cce', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2eb4cf-f9c6-42a5-92df-7ec6950cc7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2eb4cf-f9c6-42a5-92df-7ec6950cc7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae3be13-33b7-4c52-b12c-f252260c7355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:46 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Volume 2def116c-8664-439a-a55f-5ede433f8cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2def116c-8664-439a-a55f-5ede433f8cce', 'volume_size': 1} Jun 20 00:06:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:47 devstack sudo[129396]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.info" returned: 0 in 0.891s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:47 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.info is being set with open permissions: ugo+rw Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:47 devstack sudo[129426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.info Jun 20 00:06:47 devstack sudo[129426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:47 devstack sudo[129426]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.info" returned: 0 in 0.727s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.264s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-672235420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2def116c-8664-439a-a55f-5ede433f8cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2856740adc2f4ca484152dfde338eb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:47Z,use_quota=True,user_id='a0f65fe638c041d0b4109181a1a9ee0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Creating volume 2def116c-8664-439a-a55f-5ede433f8cce {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:47 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:47 devstack sudo[129450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce 1073741824 Jun 20 00:06:47 devstack sudo[129450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:47 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8cbc45e3-4c8c-4756-9387-481602f046f7 tempest-VolumesSnapshotListTestJSON-574399185 None] Create snapshot completed successfully Jun 20 00:06:48 devstack sudo[129450]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce 1073741824" returned: 0 in 0.890s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:48 devstack sudo[129484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce Jun 20 00:06:48 devstack sudo[129484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:49 devstack sudo[129484]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce" returned: 0 in 0.752s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.385s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Creating offline snapshot c4585b8e-64d0-4a06-88ef-9fcdfcf21432 of volume 240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae3be13-33b7-4c52-b12c-f252260c7355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2def116c-8664-439a-a55f-5ede433f8cce', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c715609-6da6-4581-ac49-31b1ecce26d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf08216-3be1-42ea-8b62-922b488db24f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:49 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Volume volume-2def116c-8664-439a-a55f-5ede433f8cce (2def116c-8664-439a-a55f-5ede433f8cce): created successfully Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c715609-6da6-4581-ac49-31b1ecce26d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Flow 'volume_create_manager' (bfdf5c9a-a906-46d1-aa2c-9389945cf28b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:49 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c6e4bc3e-0f58-47b3-8230-a4e383a3804a tempest-VolumesListAdminTestJSON-962219188 None] Created volume successfully. Jun 20 00:06:49 devstack sudo[129515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 Jun 20 00:06:49 devstack sudo[129515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:50 devstack sudo[129515]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844" returned: 0 in 0.854s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240d3020-9a0d-43a4-91df-037384ec3e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:06:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:50 devstack sudo[129547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 1G Jun 20 00:06:50 devstack sudo[129547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:51 devstack sudo[129547]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 1G" returned: 0 in 0.907s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:51 devstack sudo[129605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 Jun 20 00:06:51 devstack sudo[129605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Flow 'volume_create_manager' (3447ef37-ba7b-4cb4-a9e0-65100976a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d1d4b0-4a83-43f6-a22a-e378aa67521b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d1d4b0-4a83-43f6-a22a-e378aa67521b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756199793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aab0dac-2a4a-4f46-8e76-3d042eef3bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2856740adc2f4ca484152dfde338eb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:51Z,use_quota=True,user_id='a0f65fe638c041d0b4109181a1a9ee0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bb6326-2053-4345-8618-ea6fc199267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bb6326-2053-4345-8618-ea6fc199267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7eca228-263f-4a4e-a481-7be7eb6bb2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7eca228-263f-4a4e-a481-7be7eb6bb2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aab0dac-2a4a-4f46-8e76-3d042eef3bfb', 'volume_name': 'volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47d15a8-4755-4681-b4b7-2e3768c7cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47d15a8-4755-4681-b4b7-2e3768c7cb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a95337-6289-4208-8c3f-4e3dafcb2fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:51 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Volume 1aab0dac-2a4a-4f46-8e76-3d042eef3bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb', 'volume_size': 1} Jun 20 00:06:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:52 devstack sudo[129605]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432" returned: 0 in 0.742s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:52 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 is being set with open permissions: ugo+rw Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:52 devstack sudo[129633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 Jun 20 00:06:52 devstack sudo[129633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:52 devstack sudo[129633]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432" returned: 0 in 0.682s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.322s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-756199793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aab0dac-2a4a-4f46-8e76-3d042eef3bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2856740adc2f4ca484152dfde338eb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:51Z,use_quota=True,user_id='a0f65fe638c041d0b4109181a1a9ee0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Creating volume 1aab0dac-2a4a-4f46-8e76-3d042eef3bfb {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:52 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:52 devstack sudo[129660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb 1073741824 Jun 20 00:06:52 devstack sudo[129660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:52 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0abe2779-0a17-4399-bdf6-e4b9c9a587f1 tempest-VolumesSnapshotListTestJSON-574399185 None] Create snapshot completed successfully Jun 20 00:06:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-039d34e8-916f-48c7-83e3-3ca220763b56 req-0ad9ef16-f03b-48cf-b6e2-77ea77f46b09 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:54 devstack sudo[129660]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb 1073741824" returned: 0 in 1.131s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=75,cinder:UPDATE=94,cinder:INSERT=28,cinder:DELETE=7 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:54 devstack sudo[129778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb Jun 20 00:06:54 devstack sudo[129778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:54 devstack sudo[129778]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb" returned: 0 in 0.650s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-039d34e8-916f-48c7-83e3-3ca220763b56 req-0ad9ef16-f03b-48cf-b6e2-77ea77f46b09 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.072s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a95337-6289-4208-8c3f-4e3dafcb2fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d14baa8-878b-4a03-ad7a-631f462b1d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e73adfe-2ce5-4daa-8747-c12a6491ff6d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-039d34e8-916f-48c7-83e3-3ca220763b56 req-0ad9ef16-f03b-48cf-b6e2-77ea77f46b09 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=85,cinder:SELECT=88,cinder:INSERT=21,cinder:DELETE=6 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:06:54 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Volume volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb (1aab0dac-2a4a-4f46-8e76-3d042eef3bfb): created successfully Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d14baa8-878b-4a03-ad7a-631f462b1d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Flow 'volume_create_manager' (3447ef37-ba7b-4cb4-a9e0-65100976a7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:54 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1daf72f4-027c-4bd3-8881-200330cef2c2 tempest-VolumesListAdminTestJSON-962219188 None] Created volume successfully. Jun 20 00:06:54 devstack sudo[129800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 Jun 20 00:06:54 devstack sudo[129800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:55 devstack sudo[129800]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-039d34e8-916f-48c7-83e3-3ca220763b56 req-0ad9ef16-f03b-48cf-b6e2-77ea77f46b09 tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671" returned: 0 in 0.772s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-039d34e8-916f-48c7-83e3-3ca220763b56 req-0ad9ef16-f03b-48cf-b6e2-77ea77f46b09 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.869s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Creating offline snapshot 6e2e8352-2f06-44b7-943e-946b251b49aa of volume 240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:06:55 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2324a8-e973-4e42-9516-e2651a5444e2]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-039d34e8-916f-48c7-83e3-3ca220763b56 req-0ad9ef16-f03b-48cf-b6e2-77ea77f46b09 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-cf6d2397-ae4a-4d18-95ec-768339931671', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '778430e8-9d77-48d4-a785-e1c714264522', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:06:55 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-039d34e8-916f-48c7-83e3-3ca220763b56 req-0ad9ef16-f03b-48cf-b6e2-77ea77f46b09 tempest-TestServerVolumeAttachmentScenario-1487688788 None] attachment_update completed successfully. Jun 20 00:06:55 devstack sudo[129833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 Jun 20 00:06:55 devstack sudo[129833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Flow 'volume_create_manager' (4d04e5dc-b55e-41d8-8cec-0b546d876243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a011f0-fd48-4365-81c8-89df8cddb53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a011f0-fd48-4365-81c8-89df8cddb53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-101013906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d19ddf9-1819-4cfb-a020-d02ab4a639c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2856740adc2f4ca484152dfde338eb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:56Z,use_quota=True,user_id='a0f65fe638c041d0b4109181a1a9ee0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cc1895-f6c0-4694-80cc-27334cb6d0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cc1895-f6c0-4694-80cc-27334cb6d0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf51eed0-923d-4f9a-b60e-4a21513244d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf51eed0-923d-4f9a-b60e-4a21513244d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d19ddf9-1819-4cfb-a020-d02ab4a639c0', 'volume_name': 'volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d61083-520a-46dc-8fae-9591f5197f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d61083-520a-46dc-8fae-9591f5197f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39fa1e66-ee65-439b-bf39-ce68f66f8a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:06:56 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Volume 1d19ddf9-1819-4cfb-a020-d02ab4a639c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0', 'volume_size': 1} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:56 devstack sudo[129833]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432" returned: 0 in 0.826s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240d3020-9a0d-43a4-91df-037384ec3e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:06:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:56 devstack sudo[129862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa 1G Jun 20 00:06:56 devstack sudo[129862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:57 devstack sudo[129862]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa 1G" returned: 0 in 0.894s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:57 devstack sudo[129900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa Jun 20 00:06:57 devstack sudo[129900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:58 devstack sudo[129900]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa" returned: 0 in 0.682s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:58 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa is being set with open permissions: ugo+rw Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:58 devstack sudo[129926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa Jun 20 00:06:58 devstack sudo[129926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:58 devstack sudo[129926]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa" returned: 0 in 0.642s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.145s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.360s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-101013906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d19ddf9-1819-4cfb-a020-d02ab4a639c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2856740adc2f4ca484152dfde338eb19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:06:56Z,use_quota=True,user_id='a0f65fe638c041d0b4109181a1a9ee0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Creating volume 1d19ddf9-1819-4cfb-a020-d02ab4a639c0 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:06:58 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:06:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:58 devstack sudo[129947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 1073741824 Jun 20 00:06:58 devstack sudo[129947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c5ab0e44-4fcb-4f0c-9ccf-a97e7dd90551 tempest-VolumesSnapshotListTestJSON-574399185 None] Create snapshot completed successfully Jun 20 00:06:59 devstack sudo[129947]: pam_unix(sudo:session): session closed for user root Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 1073741824" returned: 0 in 0.919s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:59 devstack sudo[129989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 Jun 20 00:06:59 devstack sudo[129989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-6e2e8352-2f06-44b7-943e-946b251b49aa-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-6e2e8352-2f06-44b7-943e-946b251b49aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-quobyte-6e2e8352-2f06-44b7-943e-946b251b49aa" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-6e2e8352-2f06-44b7-943e-946b251b49aa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Deleting offline snapshot 6e2e8352-2f06-44b7-943e-946b251b49aa of volume 240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] snapshot_file for this snap is: volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47403724-4ee0-4b5c-a821-7c0d973c90b1]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:06:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:06:59 devstack sudo[129994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa Jun 20 00:06:59 devstack sudo[129994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:00 devstack sudo[129989]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0" returned: 0 in 0.708s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39fa1e66-ee65-439b-bf39-ce68f66f8a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725fb185-f97f-4747-b53f-fc49cd91366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:00 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Volume volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 (1d19ddf9-1819-4cfb-a020-d02ab4a639c0): created successfully Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725fb185-f97f-4747-b53f-fc49cd91366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Flow 'volume_create_manager' (4d04e5dc-b55e-41d8-8cec-0b546d876243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:00 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-586ad585-dc48-4abb-ae14-543aba331f60 tempest-VolumesListAdminTestJSON-962219188 None] Created volume successfully. Jun 20 00:07:00 devstack sudo[129994]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa" returned: 0 in 0.813s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240d3020-9a0d-43a4-91df-037384ec3e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5160d9-017e-4393-b3f7-ae2740355d72]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:00 devstack sudo[130027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 Jun 20 00:07:00 devstack sudo[130027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:01 devstack sudo[130027]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432" returned: 0 in 0.851s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240d3020-9a0d-43a4-91df-037384ec3e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:07:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:01 devstack sudo[130056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa Jun 20 00:07:01 devstack sudo[130056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Flow 'volume_create_manager' (03a17106-cf0c-4b99-8a7b-37971a5fe599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcdbda1e-ff28-4aa4-9af6-f1f2b2e9c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcdbda1e-ff28-4aa4-9af6-f1f2b2e9c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c69392-ea7f-41be-8610-590bf4f9be82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6b7d91269b42a6a1209e8e4c9c9f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:02Z,use_quota=True,user_id='b186c18a570945028c8c456196b11513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64f84c3-ec29-4fcb-8cd3-fc8329c6c192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64f84c3-ec29-4fcb-8cd3-fc8329c6c192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd40e411-30ec-41a9-a6f6-c3739deedbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd40e411-30ec-41a9-a6f6-c3739deedbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c69392-ea7f-41be-8610-590bf4f9be82', 'volume_name': 'volume-e5c69392-ea7f-41be-8610-590bf4f9be82', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4cc016-58c1-4c62-b67b-c1df9f323bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4cc016-58c1-4c62-b67b-c1df9f323bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c147a2ee-8fd1-42b8-92b2-9e692c65f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:02 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Volume e5c69392-ea7f-41be-8610-590bf4f9be82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c69392-ea7f-41be-8610-590bf4f9be82', 'volume_size': 1} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5c69392-ea7f-41be-8610-590bf4f9be82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6b7d91269b42a6a1209e8e4c9c9f13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:02Z,use_quota=True,user_id='b186c18a570945028c8c456196b11513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Creating volume e5c69392-ea7f-41be-8610-590bf4f9be82 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:07:02 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:02 devstack sudo[130092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 1073741824 Jun 20 00:07:02 devstack sudo[130092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:02 devstack sudo[130056]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa" returned: 0 in 1.095s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:02 devstack sudo[130097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa Jun 20 00:07:02 devstack sudo[130097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:03 devstack sudo[130097]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.6e2e8352-2f06-44b7-943e-946b251b49aa" returned: 0 in 0.952s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-6e2e8352-2f06-44b7-943e-946b251b49aa" released by "_delete_snapshot" :: held 3.833s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" released by "delete_snapshot" :: held 3.857s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:03 devstack sudo[130092]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 1073741824" returned: 0 in 1.108s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:03 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Created reservations ['9bf8598b-5f60-495c-8661-14b637a9b84f', 'c0dfc66e-5434-4749-91e1-faf6744e992a', '7e7c7752-f2e4-4e73-990a-066e9f05700b', 'd2275c7a-ccb9-4e6e-9a71-698712fd401e'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:03 devstack sudo[130142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 Jun 20 00:07:03 devstack sudo[130142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Delete snapshot completed successfully. Jun 20 00:07:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f68e154b-a345-4bea-928f-d108993829fc tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-6e2e8352-2f06-44b7-943e-946b251b49aa-delete_snapshot" released by "delete_snapshot" :: held 4.031s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:04 devstack sudo[130142]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82" returned: 0 in 0.684s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c147a2ee-8fd1-42b8-92b2-9e692c65f29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c69392-ea7f-41be-8610-590bf4f9be82', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930332a3-1a19-4d64-b456-e80cae312c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-c4585b8e-64d0-4a06-88ef-9fcdfcf21432-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:04 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Volume volume-e5c69392-ea7f-41be-8610-590bf4f9be82 (e5c69392-ea7f-41be-8610-590bf4f9be82): created successfully Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930332a3-1a19-4d64-b456-e80cae312c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Flow 'volume_create_manager' (03a17106-cf0c-4b99-8a7b-37971a5fe599) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-c4585b8e-64d0-4a06-88ef-9fcdfcf21432-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7a7248ab-7f38-4e1c-b0d4-04bc750e650e tempest-VolumesListAdminTestJSON-49243846 None] Created volume successfully. Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-quobyte-c4585b8e-64d0-4a06-88ef-9fcdfcf21432" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-c4585b8e-64d0-4a06-88ef-9fcdfcf21432" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Deleting offline snapshot c4585b8e-64d0-4a06-88ef-9fcdfcf21432 of volume 240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] snapshot_file for this snap is: volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fb899b-5f7d-4076-bf2e-a1bf78054b1a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:04 devstack sudo[130173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 Jun 20 00:07:04 devstack sudo[130173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:05 devstack sudo[130173]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432" returned: 0 in 0.792s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240d3020-9a0d-43a4-91df-037384ec3e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f588b6ed-01e5-4019-810c-3916cc27c9c6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:05 devstack sudo[130205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 Jun 20 00:07:05 devstack sudo[130205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Acquiring lock "cinder-e5c69392-ea7f-41be-8610-590bf4f9be82-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Lock "cinder-e5c69392-ea7f-41be-8610-590bf4f9be82-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Acquiring lock "cinder-quobyte-e5c69392-ea7f-41be-8610-590bf4f9be82" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Lock "cinder-quobyte-e5c69392-ea7f-41be-8610-590bf4f9be82" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c262928-bbc8-45f7-bcf4-2ead043c0919]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "cinder-1d19ddf9-1819-4cfb-a020-d02ab4a639c0-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-1d19ddf9-1819-4cfb-a020-d02ab4a639c0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "cinder-quobyte-1d19ddf9-1819-4cfb-a020-d02ab4a639c0" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:05 devstack sudo[130222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 Jun 20 00:07:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-quobyte-1d19ddf9-1819-4cfb-a020-d02ab4a639c0" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:05 devstack sudo[130222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[19787212-c8b5-4b6e-9c4b-594eb0f463db]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:06 devstack sudo[130230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 Jun 20 00:07:06 devstack sudo[130230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:06 devstack sudo[130205]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844" returned: 0 in 0.875s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240d3020-9a0d-43a4-91df-037384ec3e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:07:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:06 devstack sudo[130241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 Jun 20 00:07:06 devstack sudo[130241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-fbf8422e-e4bd-4935-92a1-047dfeff4cce req-52f0f48e-d2d4-47d3-89bf-82c641933544 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-fbf8422e-e4bd-4935-92a1-047dfeff4cce req-52f0f48e-d2d4-47d3-89bf-82c641933544 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:07 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa946044-ffc8-4b9c-9e23-1b7cf94bd22c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-fbf8422e-e4bd-4935-92a1-047dfeff4cce req-52f0f48e-d2d4-47d3-89bf-82c641933544 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:07 devstack sudo[130222]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82" returned: 0 in 1.386s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:07 devstack sudo[130329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82 Jun 20 00:07:07 devstack sudo[130329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:07 devstack sudo[130320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec Jun 20 00:07:07 devstack sudo[130320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:07 devstack sudo[130230]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0" returned: 0 in 1.393s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:07 devstack sudo[130343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0 Jun 20 00:07:07 devstack sudo[130343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:07 devstack sudo[130241]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432" returned: 0 in 1.488s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:07 devstack sudo[130356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432 Jun 20 00:07:07 devstack sudo[130356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:08 devstack sudo[130329]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e5c69392-ea7f-41be-8610-590bf4f9be82" returned: 0 in 1.023s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Lock "cinder-quobyte-e5c69392-ea7f-41be-8610-590bf4f9be82" released by "delete_volume" :: held 2.478s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Created reservations ['3c8ef53e-54e5-49b9-bd5a-fc9c53bb0817', '4680404a-a461-4ad9-bfbf-50803edbd124', '0d85f4d8-1a4a-440f-a20d-1e741161eca9', '35ded0f4-ff24-4065-93b9-af4ffae15fa2'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:08 devstack sudo[130343]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1d19ddf9-1819-4cfb-a020-d02ab4a639c0" returned: 0 in 0.977s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-quobyte-1d19ddf9-1819-4cfb-a020-d02ab4a639c0" released by "delete_volume" :: held 2.444s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:08 devstack sudo[130320]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-fbf8422e-e4bd-4935-92a1-047dfeff4cce req-52f0f48e-d2d4-47d3-89bf-82c641933544 tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec" returned: 0 in 1.434s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-fbf8422e-e4bd-4935-92a1-047dfeff4cce req-52f0f48e-d2d4-47d3-89bf-82c641933544 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.503s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:08 devstack sudo[130386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:08 devstack sudo[130386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-fbf8422e-e4bd-4935-92a1-047dfeff4cce req-52f0f48e-d2d4-47d3-89bf-82c641933544 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-b65f7fad-1e02-4b59-8028-00aeab8753ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2325d86-a70e-4494-a3bc-b9ca30e3e6dd', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Created reservations ['e723a534-9259-4780-b9a2-e8a64eda1d8d', '6597e5b3-dcbe-40be-89cd-756ae8020718', 'faf315f7-8d65-4fb2-80c4-8a3cda5681f5', 'aea32fbd-2ee4-4e0d-b619-cfc6e34aa466'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-fbf8422e-e4bd-4935-92a1-047dfeff4cce req-52f0f48e-d2d4-47d3-89bf-82c641933544 tempest-TestServerVolumeAttachmentScenario-1487688788 None] attachment_update completed successfully. Jun 20 00:07:08 devstack sudo[130356]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.c4585b8e-64d0-4a06-88ef-9fcdfcf21432" returned: 0 in 1.022s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:08 devstack sudo[130398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:08 devstack sudo[130398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-c4585b8e-64d0-4a06-88ef-9fcdfcf21432" released by "_delete_snapshot" :: held 4.297s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" released by "delete_snapshot" :: held 4.330s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Created reservations ['87eeed65-d15a-441f-bceb-097281bb3981', '04453711-b3ff-4b9e-9db7-e0ad446fb9d6', 'de59eb2d-cada-48eb-ab9d-37793c9a0817', '17908a74-0f34-4934-bd49-4c1e1ba47dd8'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Delete snapshot completed successfully. Jun 20 00:07:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1b15981e-c4bc-4e26-819b-7c40ce136370 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-c4585b8e-64d0-4a06-88ef-9fcdfcf21432-delete_snapshot" released by "delete_snapshot" :: held 4.515s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:09 devstack sudo[130386]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.786s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Deleted volume successfully. Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-be336b44-1355-4742-b4ab-4b3f832391a9 tempest-VolumesListAdminTestJSON-49243846 None] Lock "cinder-e5c69392-ea7f-41be-8610-590bf4f9be82-delete_volume" released by "delete_volume" :: held 3.609s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "cinder-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "cinder-quobyte-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-quobyte-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e175728-c4f4-4e48-b748-61f74a3e41c2]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:09 devstack sudo[130398]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.862s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Deleted volume successfully. Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4fec5c-6f66-4045-bf92-b4ca3205eec9 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-1d19ddf9-1819-4cfb-a020-d02ab4a639c0-delete_volume" released by "delete_volume" :: held 3.754s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:09 devstack sudo[130428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb Jun 20 00:07:09 devstack sudo[130428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-585b9905-103f-428b-acf0-8defb9436844-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-585b9905-103f-428b-acf0-8defb9436844-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-quobyte-585b9905-103f-428b-acf0-8defb9436844" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-585b9905-103f-428b-acf0-8defb9436844" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Deleting offline snapshot 585b9905-103f-428b-acf0-8defb9436844 of volume 240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] snapshot_file for this snap is: volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c57088c-4db2-469b-8bcb-f2e8f364be34]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:10 devstack sudo[130446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 Jun 20 00:07:10 devstack sudo[130446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:10 devstack sudo[130428]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb" returned: 0 in 0.955s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:10 devstack sudo[130468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb Jun 20 00:07:10 devstack sudo[130468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:10 devstack sudo[130446]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844" returned: 0 in 0.861s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-240d3020-9a0d-43a4-91df-037384ec3e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:07:10 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b43f73-e992-4600-9c2b-22dd1a2298d9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:10 devstack sudo[130486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 Jun 20 00:07:10 devstack sudo[130486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:11 devstack sudo[130468]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb" returned: 0 in 0.752s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-quobyte-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb" released by "delete_volume" :: held 1.779s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Created reservations ['a205c1ff-a6b0-4faa-8efd-06f12bff6c8d', '6fb448c2-0931-48d6-bd55-82b151a94962', '435759dc-9444-4a39-b83a-08850b10e47d', 'c9b38e83-aac6-4a72-bd25-161c2b5f0477'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:11 devstack sudo[130505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:11 devstack sudo[130505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "cinder-2def116c-8664-439a-a55f-5ede433f8cce-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:11 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-6cac422a-c7d3-487d-af1d-b69881154061 req-46270026-d5d1-43c5-a729-3c140bcb5653 tempest-TestShelveInstance-855873225 None] Terminate volume connection completed successfully. Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-6cac422a-c7d3-487d-af1d-b69881154061 req-46270026-d5d1-43c5-a729-3c140bcb5653 tempest-TestShelveInstance-855873225 None] Deleting attachment 07e27b2f-d102-49a8-ac98-e0cac92df3b9. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:07:11 devstack sudo[130486]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11" returned: 0 in 0.940s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-2def116c-8664-439a-a55f-5ede433f8cce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:11 devstack sudo[130524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 Jun 20 00:07:11 devstack sudo[130524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "cinder-quobyte-2def116c-8664-439a-a55f-5ede433f8cce" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-quobyte-2def116c-8664-439a-a55f-5ede433f8cce" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f558e3bf-e236-473f-aa74-7a113fc4541c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:12 devstack sudo[130529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce Jun 20 00:07:12 devstack sudo[130529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:12 devstack sudo[130505]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.911s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:12 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:12 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Deleted volume successfully. Jun 20 00:07:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5acf10c6-ead2-4b4d-a010-6f0a44412f20 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-1aab0dac-2a4a-4f46-8e76-3d042eef3bfb-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:12 devstack sudo[130524]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844" returned: 0 in 1.005s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:12 devstack sudo[130566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844 Jun 20 00:07:12 devstack sudo[130566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:12 devstack sudo[130529]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce" returned: 0 in 1.045s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:12 devstack sudo[130571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce Jun 20 00:07:12 devstack sudo[130571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:13 devstack sudo[130566]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11.585b9905-103f-428b-acf0-8defb9436844" returned: 0 in 0.759s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-585b9905-103f-428b-acf0-8defb9436844" released by "_delete_snapshot" :: held 3.709s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" released by "delete_snapshot" :: held 3.737s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Created reservations ['d793d47a-168f-4479-a622-b4c04421e8b9', 'affa24c7-a4eb-4980-ae9c-68e899cb2b7d', '80f8abaa-9fea-4247-abaa-7f31f255dadd', '5f6858f9-ac8f-4b9e-a2bd-44187bbf7693'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:13 devstack sudo[130571]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2def116c-8664-439a-a55f-5ede433f8cce" returned: 0 in 0.755s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-quobyte-2def116c-8664-439a-a55f-5ede433f8cce" released by "delete_volume" :: held 1.853s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:13 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Delete snapshot completed successfully. Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bd852eb1-597d-4e43-be9f-88420d764d85 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-585b9905-103f-428b-acf0-8defb9436844-delete_snapshot" released by "delete_snapshot" :: held 3.929s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Created reservations ['d8c6de95-a858-4ac6-87e9-3da8b47eb651', '92658098-b962-4c4f-9c4f-322e71976bb3', 'e005167e-6947-436d-8836-5a6b0bbb4071', 'f428ce9d-6298-430e-94e8-1e6172e56cd0'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:13 devstack sudo[130610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:13 devstack sudo[130610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-240d3020-9a0d-43a4-91df-037384ec3e11-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-240d3020-9a0d-43a4-91df-037384ec3e11-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" acquired by "delete_volume" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a37619-daef-4ebf-9a10-2448feca63e8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:14 devstack sudo[130634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 Jun 20 00:07:14 devstack sudo[130634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:14 devstack sudo[130610]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.972s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Deleted volume successfully. Jun 20 00:07:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d151d26b-5092-4a55-89b5-aec9cdf7b7f2 tempest-VolumesListAdminTestJSON-962219188 None] Lock "cinder-2def116c-8664-439a-a55f-5ede433f8cce-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:15 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-6f7a1337-d53b-46a7-91b9-c3e5aed680e0 req-b6055c68-1721-494d-802c-ed71aff15a3c tempest-TestServerVolumeAttachmentScenario-1487688788 None] Terminate volume connection completed successfully. Jun 20 00:07:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-6f7a1337-d53b-46a7-91b9-c3e5aed680e0 req-b6055c68-1721-494d-802c-ed71aff15a3c tempest-TestServerVolumeAttachmentScenario-1487688788 None] Deleting attachment c2325d86-a70e-4494-a3bc-b9ca30e3e6dd. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:07:15 devstack sudo[130634]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11" returned: 0 in 1.110s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:15 devstack sudo[130682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11 Jun 20 00:07:15 devstack sudo[130682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:16 devstack sudo[130682]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-240d3020-9a0d-43a4-91df-037384ec3e11" returned: 0 in 0.736s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-quobyte-240d3020-9a0d-43a4-91df-037384ec3e11" released by "delete_volume" :: held 1.945s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Created reservations ['ddaa5ce4-0187-4f76-9412-29e38b9c482f', '00c23f99-62c7-4751-93ba-41be496695cf', '17f56f9b-ab47-4539-8659-b1373eeb5a85', '91a9c42a-78b1-47d7-821c-4cd7e641623f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:16 devstack sudo[130715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:16 devstack sudo[130715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:17 devstack sudo[130715]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.036s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:17 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Deleted volume successfully. Jun 20 00:07:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-862cc2da-7779-440f-b2b8-6173bee55cb9 tempest-VolumesSnapshotListTestJSON-574399185 None] Lock "cinder-240d3020-9a0d-43a4-91df-037384ec3e11-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:18 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a52401-31d7-4dea-8e4b-9a5e48fb2697]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:18 devstack sudo[130813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:07:18 devstack sudo[130813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:19 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-881177d9-3c40-4a4b-92c8-2c6aa4a1f0eb req-f4525751-3538-461a-9509-04758cc65f22 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Terminate volume connection completed successfully. Jun 20 00:07:19 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-881177d9-3c40-4a4b-92c8-2c6aa4a1f0eb req-f4525751-3538-461a-9509-04758cc65f22 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Deleting attachment 778430e8-9d77-48d4-a785-e1c714264522. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:07:19 devstack sudo[130813]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 0 in 1.025s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:19 devstack sudo[130853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:07:19 devstack sudo[130853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:20 devstack sudo[130853]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 1 in 0.912s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:07:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.995s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-e481d90b-684a-4094-9154-0c3b744981e3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '200fafb6-9610-40ac-8d05-89b9864e1313', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:07:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-17043c99-3b2a-4504-b599-06f71e531d8b req-d1042daa-362b-4b07-a163-fb471c19193c tempest-TestShelveInstance-855873225 None] attachment_update completed successfully. Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Flow 'volume_create_manager' (0d2df5c8-227c-43b1-91ee-87ee0719d47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1891f509-f20c-4291-84bf-2f1675ba4a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1891f509-f20c-4291-84bf-2f1675ba4a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1982151870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c69112-b75d-4817-b32e-20215de1c8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cbc4539ddb04d388c17d287bf606b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:21Z,use_quota=True,user_id='6fab901acc5246e89040e82417ff990b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e827a-6170-4968-8d00-67d71241ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e64e827a-6170-4968-8d00-67d71241ea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169375b9-d954-44d1-8886-af4621d94b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169375b9-d954-44d1-8886-af4621d94b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8c69112-b75d-4817-b32e-20215de1c8a9', 'volume_name': 'volume-f8c69112-b75d-4817-b32e-20215de1c8a9', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40c783b-dfe6-4f2f-b7d7-ad76fe7ffebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40c783b-dfe6-4f2f-b7d7-ad76fe7ffebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c730353d-280e-4ee0-a655-559cfe0649ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:21 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Volume f8c69112-b75d-4817-b32e-20215de1c8a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8c69112-b75d-4817-b32e-20215de1c8a9', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 20 00:07:21 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Trying to clone f8c69112-b75d-4817-b32e-20215de1c8a9 from image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:07:22 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:07:22 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Image download 20.69 MB at 20.69 MB/s Jun 20 00:07:22 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e206b591-bbc3-4024-850c-4337bf7c6a24]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:22 devstack sudo[130943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD Jun 20 00:07:22 devstack sudo[130943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:23 devstack sudo[130943]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD" returned: 0 in 1.028s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:23 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Temporary image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec is fetched for user 6fab901acc5246e89040e82417ff990b. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:07:23 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbab0ac-6c3d-4f85-9a97-d69fed676168]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:23 devstack sudo[131018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD Jun 20 00:07:23 devstack sudo[131018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:24 devstack sudo[131018]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1982151870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c69112-b75d-4817-b32e-20215de1c8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cbc4539ddb04d388c17d287bf606b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:21Z,use_quota=True,user_id='6fab901acc5246e89040e82417ff990b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Creating volume f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:07:24 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:07:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:24 devstack sudo[131052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 1073741824 Jun 20 00:07:24 devstack sudo[131052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:25 devstack sudo[131052]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 1073741824" returned: 0 in 1.170s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:25 devstack sudo[131097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 Jun 20 00:07:25 devstack sudo[131097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:26 devstack sudo[131097]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9" returned: 0 in 0.750s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:07:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:26 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Attempting download of 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec ((None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}])) to volume f8c69112-b75d-4817-b32e-20215de1c8a9. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:07:26 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6c05bc-aa9b-4b17-840d-3c8b94a05d5d]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_9zg8lsrb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:26 devstack sudo[131128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_9zg8lsrb Jun 20 00:07:26 devstack sudo[131128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:27 devstack sudo[131128]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_9zg8lsrb" returned: 0 in 0.928s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_9zg8lsrb {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:27 devstack sudo[131160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_9zg8lsrb Jun 20 00:07:27 devstack sudo[131160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:28 devstack sudo[131188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:28 devstack sudo[131188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:28 devstack sudo[131160]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_9zg8lsrb" returned: 1 in 0.896s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_9zg8lsrb' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff74e817-0185-40cb-95c6-f271758aca1f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:28 devstack sudo[131193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD Jun 20 00:07:28 devstack sudo[131193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:29 devstack sudo[131188]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.064s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:07:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:07:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:07:29 devstack sudo[131193]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD" returned: 0 in 1.014s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:29 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec was qcow2, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:07:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:29 devstack sudo[131229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 Jun 20 00:07:29 devstack sudo[131229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "cinder-b65f7fad-1e02-4b59-8028-00aeab8753ec-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "cinder-b65f7fad-1e02-4b59-8028-00aeab8753ec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "cinder-quobyte-b65f7fad-1e02-4b59-8028-00aeab8753ec" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "cinder-quobyte-b65f7fad-1e02-4b59-8028-00aeab8753ec" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf3b069-2113-477d-91df-f1260310d1b1]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:31 devstack sudo[131229]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9" returned: 0 in 2.690s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1139f52c-4e8a-4fbb-ad0c-520c15fd30ec_1pj2n_4mdevstack@QuobyteHD, size 112.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:07:31 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Converted 112.00 MB image at 41.61 MB/s Jun 20 00:07:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:31 devstack sudo[131383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec Jun 20 00:07:31 devstack sudo[131383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:31 devstack sudo[131387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 1G Jun 20 00:07:31 devstack sudo[131387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec" returned: 0 in 1.015s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:32 devstack sudo[131383]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:32 devstack sudo[131744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec Jun 20 00:07:32 devstack sudo[131744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:32 devstack sudo[131387]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 1G" returned: 0 in 0.964s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:32 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad976fe-d8c3-40f8-be0c-a3fff1447e2b]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:32 devstack sudo[131751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 Jun 20 00:07:32 devstack sudo[131751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:33 devstack sudo[131744]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b65f7fad-1e02-4b59-8028-00aeab8753ec" returned: 0 in 1.094s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:33 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "cinder-quobyte-b65f7fad-1e02-4b59-8028-00aeab8753ec" released by "delete_volume" :: held 2.208s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Created reservations ['68cdf184-07f9-473f-afa3-4fe0438724a0', '5533a8db-2b23-4ef2-add6-30a834a188fc', 'bea3eb9d-0b49-4085-acdd-ca0e60628f03', 'c63237fc-d4a3-4aa4-8ced-8228276dba9d'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:34 devstack sudo[131854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:34 devstack sudo[131854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:34 devstack sudo[131751]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9" returned: 0 in 1.705s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:34 devstack sudo[131876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 Jun 20 00:07:34 devstack sudo[131876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "cinder-cf6d2397-ae4a-4d18-95ec-768339931671-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "cinder-cf6d2397-ae4a-4d18-95ec-768339931671-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "cinder-quobyte-cf6d2397-ae4a-4d18-95ec-768339931671" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "cinder-quobyte-cf6d2397-ae4a-4d18-95ec-768339931671" acquired by "delete_volume" :: waited 0.026s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[763b4b88-5bed-4c32-a557-19315160276a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:35 devstack sudo[131902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 Jun 20 00:07:35 devstack sudo[131902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:35 devstack sudo[131854]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.477s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:35 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Deleted volume successfully. Jun 20 00:07:35 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-73a4bdb2-22a1-4e3a-b9a8-b679f704f3b0 tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "cinder-b65f7fad-1e02-4b59-8028-00aeab8753ec-delete_volume" released by "delete_volume" :: held 4.130s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:36 devstack sudo[131876]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9" returned: 1 in 1.684s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Downloaded image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec ((None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}])) to volume f8c69112-b75d-4817-b32e-20215de1c8a9 successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Temporary image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec for user 6fab901acc5246e89040e82417ff990b is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Marking volume f8c69112-b75d-4817-b32e-20215de1c8a9 as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Copying metadata from image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec to f8c69112-b75d-4817-b32e-20215de1c8a9. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Creating volume glance metadata for volume f8c69112-b75d-4817-b32e-20215de1c8a9 backed by image 1139f52c-4e8a-4fbb-ad0c-520c15fd30ec with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c730353d-280e-4ee0-a655-559cfe0649ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8c69112-b75d-4817-b32e-20215de1c8a9', 'volume_size': 1, 'image_id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7cf6f7b240ec43e7997fb14be7bd7965', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1139f52c-4e8a-4fbb-ad0c-520c15fd30ec', 'created_at': datetime.datetime(2026, 6, 19, 21, 45, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 21, 45, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1139f52c-4e8a-4fbb-ad0c-520c15fd30ec/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ac5d18-1332-4e3d-ac09-593b54be144e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Volume volume-f8c69112-b75d-4817-b32e-20215de1c8a9 (f8c69112-b75d-4817-b32e-20215de1c8a9): created successfully Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ac5d18-1332-4e3d-ac09-593b54be144e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Flow 'volume_create_manager' (0d2df5c8-227c-43b1-91ee-87ee0719d47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:36 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bcd85b7a-9b6f-414e-acee-fd1bac34f710 tempest-VolumesImageMetadata-1243823436 None] Created volume successfully. Jun 20 00:07:36 devstack sudo[131902]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671" returned: 0 in 1.387s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:36 devstack sudo[131953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671 Jun 20 00:07:36 devstack sudo[131953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Acquiring lock "cinder-f8c69112-b75d-4817-b32e-20215de1c8a9-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Lock "cinder-f8c69112-b75d-4817-b32e-20215de1c8a9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Acquiring lock "cinder-quobyte-f8c69112-b75d-4817-b32e-20215de1c8a9" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:07:37 devstack sudo[131953]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-cf6d2397-ae4a-4d18-95ec-768339931671" returned: 0 in 1.241s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Lock "cinder-quobyte-f8c69112-b75d-4817-b32e-20215de1c8a9" acquired by "delete_volume" :: waited 0.044s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "cinder-quobyte-cf6d2397-ae4a-4d18-95ec-768339931671" released by "delete_volume" :: held 2.735s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac62e1-38e5-460b-bb10-499e277b3038]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:37 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Created reservations ['e23f6746-9b8b-41e9-8f57-7b68a02077d1', 'eace99f7-5314-4ae6-91c5-afc8a136e5f1', 'b9b61001-68dd-461c-9844-a467d36f409e', '48c2fdca-b980-4293-9966-f463e9cc295a'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:38 devstack sudo[131997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 Jun 20 00:07:38 devstack sudo[131997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:38 devstack sudo[132002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:38 devstack sudo[132002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:38 devstack sudo[132002]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.818s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:38 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Deleted volume successfully. Jun 20 00:07:38 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cc701b35-60cd-437b-9a0c-ea54734b3b9d tempest-TestServerVolumeAttachmentScenario-1487688788 None] Lock "cinder-cf6d2397-ae4a-4d18-95ec-768339931671-delete_volume" released by "delete_volume" :: held 3.897s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:39 devstack sudo[131997]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9" returned: 0 in 1.461s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:39 devstack sudo[132048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 Jun 20 00:07:39 devstack sudo[132048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:40 devstack sudo[132048]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9" returned: 1 in 1.109s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:07:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:40 devstack sudo[132087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9 Jun 20 00:07:40 devstack sudo[132087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:41 devstack sudo[132087]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-f8c69112-b75d-4817-b32e-20215de1c8a9" returned: 0 in 0.924s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Lock "cinder-quobyte-f8c69112-b75d-4817-b32e-20215de1c8a9" released by "delete_volume" :: held 3.609s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Created reservations ['c5cc66fa-226b-49b3-b7d8-ebdbe3eea35d', '20a81f40-9533-4019-acdb-5ae5eafac5df', '57d63273-252a-4b77-b9b0-91624dd04158', '2d0e3d69-124e-40ae-b1ba-679e3a4dd719'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:41 devstack sudo[132126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:07:41 devstack sudo[132126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:42 devstack sudo[132126]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.189s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:42 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:07:42 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Deleted volume successfully. Jun 20 00:07:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-908ad676-ef52-4291-b1a8-5246f489cf4e tempest-VolumesImageMetadata-1243823436 None] Lock "cinder-f8c69112-b75d-4817-b32e-20215de1c8a9-delete_volume" released by "delete_volume" :: held 5.206s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Flow 'volume_create_manager' (fc473e76-c9ec-4288-beb8-eb87392a93f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffecbfb6-ced1-43f8-80c0-f4a6587745f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffecbfb6-ced1-43f8-80c0-f4a6587745f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1884512976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d33f67-7115-4d99-a376-def6d723518f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f80408f54ae4f2c9f730241cc2c7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:50Z,use_quota=True,user_id='e78d65fadb5e421a8cfdf2cc312be17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b759f00d-4e38-4378-85a1-fe0c30e6d018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b759f00d-4e38-4378-85a1-fe0c30e6d018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9524031b-d69d-4c94-8086-ed6b78c51798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9524031b-d69d-4c94-8086-ed6b78c51798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86d33f67-7115-4d99-a376-def6d723518f', 'volume_name': 'volume-86d33f67-7115-4d99-a376-def6d723518f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55dd53d-e613-4ce2-ac69-422233770b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55dd53d-e613-4ce2-ac69-422233770b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b412d823-0d80-48bd-b5dc-359e7d084a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:49 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Volume 86d33f67-7115-4d99-a376-def6d723518f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86d33f67-7115-4d99-a376-def6d723518f', 'volume_size': 1} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1884512976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d33f67-7115-4d99-a376-def6d723518f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f80408f54ae4f2c9f730241cc2c7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:50Z,use_quota=True,user_id='e78d65fadb5e421a8cfdf2cc312be17c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Creating volume 86d33f67-7115-4d99-a376-def6d723518f {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:07:49 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:07:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:49 devstack sudo[132396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f 1073741824 Jun 20 00:07:49 devstack sudo[132396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:51 devstack sudo[132396]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f 1073741824" returned: 0 in 1.396s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:51 devstack sudo[132455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f Jun 20 00:07:51 devstack sudo[132455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:52 devstack sudo[132455]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f" returned: 0 in 0.884s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] <== create_volume: return (2339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:07:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.342s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b412d823-0d80-48bd-b5dc-359e7d084a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d33f67-7115-4d99-a376-def6d723518f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a652d71-1c39-4fe4-96d4-de28d6c383e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:52 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Volume volume-86d33f67-7115-4d99-a376-def6d723518f (86d33f67-7115-4d99-a376-def6d723518f): created successfully Jun 20 00:07:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a652d71-1c39-4fe4-96d4-de28d6c383e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Flow 'volume_create_manager' (fc473e76-c9ec-4288-beb8-eb87392a93f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:52 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d7ce780b-8011-4bae-a537-221bc23ddf9a tempest-SnapshotMetadataTestJSON-1647008329 None] Created volume successfully. Jun 20 00:07:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Creating offline snapshot 0fcc1948-97a5-4b10-9430-74ff10db85b7 of volume 86d33f67-7115-4d99-a376-def6d723518f {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:07:53 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d473dd-914f-4673-a35b-acf7345bfa22]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:07:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:53 devstack sudo[132514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f Jun 20 00:07:53 devstack sudo[132514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:54 devstack sudo[132514]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f" returned: 0 in 1.041s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:54 devstack sudo[132551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 1G Jun 20 00:07:54 devstack sudo[132551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=106,cinder:DELETE=4,cinder:SELECT=95,cinder:INSERT=31 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Flow 'volume_create_manager' (0e0959d2-7e21-49be-b49c-0e843b27ffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81380d5f-44e5-4de2-8a2c-e518a998a150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81380d5f-44e5-4de2-8a2c-e518a998a150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1942194773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e965795b-f906-4cd7-9962-a5afcf5038c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0321c5bb9ab4bf0bbaf6cd1b8e45b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:55Z,use_quota=True,user_id='54330e5dfad34ecfa61f6533df87ed47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8d01637-b044-4306-a30d-691c9c910329),volume_type_id=e8d01637-b044-4306-a30d-691c9c910329)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993e692b-3e0c-4dd2-82d5-d3dd7b090f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993e692b-3e0c-4dd2-82d5-d3dd7b090f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df693208-44b1-4f9f-9714-b0d496afc1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df693208-44b1-4f9f-9714-b0d496afc1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e965795b-f906-4cd7-9962-a5afcf5038c4', 'volume_name': 'volume-e965795b-f906-4cd7-9962-a5afcf5038c4', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67eb9571-ba0c-4d7d-86cc-10955fd80b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67eb9571-ba0c-4d7d-86cc-10955fd80b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774ffad9-6add-4cfe-8681-6888a5ede6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:54 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Volume e965795b-f906-4cd7-9962-a5afcf5038c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e965795b-f906-4cd7-9962-a5afcf5038c4', 'volume_size': 1} Jun 20 00:07:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=91,cinder:UPDATE=98,cinder:DELETE=10,cinder:INSERT=30 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Flow 'volume_create_manager' (7093c6f3-6b24-47f7-b97a-80b43aebfa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca08ff8e-9ac2-4c25-bb06-9c772b94958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca08ff8e-9ac2-4c25-bb06-9c772b94958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-279775586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03c1f4c-1bfc-4f27-9567-26aa181c1977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0321c5bb9ab4bf0bbaf6cd1b8e45b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:55Z,use_quota=True,user_id='54330e5dfad34ecfa61f6533df87ed47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0454532c-7dd5-4851-826a-04dc02d0cff1),volume_type_id=0454532c-7dd5-4851-826a-04dc02d0cff1)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e0eaf8-4109-4dec-83db-110bcea22c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e0eaf8-4109-4dec-83db-110bcea22c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5f5007-12e3-454c-91a7-f7457c693701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5f5007-12e3-454c-91a7-f7457c693701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03c1f4c-1bfc-4f27-9567-26aa181c1977', 'volume_name': 'volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1a1e98-b9eb-493b-ac54-757c384effc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1a1e98-b9eb-493b-ac54-757c384effc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd1c525-91f8-480b-bcf2-11c76c3bfc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:55 devstack sudo[132551]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:55 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Volume e03c1f4c-1bfc-4f27-9567-26aa181c1977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977', 'volume_size': 1} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 1G" returned: 0 in 1.148s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d33f67-7115-4d99-a376-def6d723518f -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:55 devstack sudo[132594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d33f67-7115-4d99-a376-def6d723518f -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 Jun 20 00:07:55 devstack sudo[132594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Flow 'volume_create_manager' (2f89310e-6855-40bb-a4c6-1541bea9aa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9739d-6f65-4c7d-a764-ac5e81cc1afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9739d-6f65-4c7d-a764-ac5e81cc1afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1714984832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0321c5bb9ab4bf0bbaf6cd1b8e45b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:56Z,use_quota=True,user_id='54330e5dfad34ecfa61f6533df87ed47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5860666-fd7e-4ead-8616-0fa6fc54aba9),volume_type_id=e5860666-fd7e-4ead-8616-0fa6fc54aba9)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b3ccad-0d1a-4e56-ba08-8917f79dbbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b3ccad-0d1a-4e56-ba08-8917f79dbbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660f8097-103c-4e8a-b57a-0e5c5af3affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:07:56 devstack sudo[132594]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86d33f67-7115-4d99-a376-def6d723518f -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7" returned: 0 in 0.836s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:56 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 is being set with open permissions: ugo+rw Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:56 devstack sudo[132625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 Jun 20 00:07:56 devstack sudo[132625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660f8097-103c-4e8a-b57a-0e5c5af3affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f', 'volume_name': 'volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f', 'volume_size': 1, 'image_id': 'a7849721-0617-49d9-aa55-5c9d57647bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7849721-0617-49d9-aa55-5c9d57647bdb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1346643314', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0321c5bb9ab4bf0bbaf6cd1b8e45b05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7849721-0617-49d9-aa55-5c9d57647bdb', 'created_at': datetime.datetime(2026, 6, 19, 22, 7, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 7, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7849721-0617-49d9-aa55-5c9d57647bdb/file', 'properties': {}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ff7888-a2f3-41c1-919a-328cd1988077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ff7888-a2f3-41c1-919a-328cd1988077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1f2cd3-a6c4-4c04-ba2a-65483e218a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:07:56 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Volume 1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f', 'volume_size': 1, 'image_id': 'a7849721-0617-49d9-aa55-5c9d57647bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7849721-0617-49d9-aa55-5c9d57647bdb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1346643314', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0321c5bb9ab4bf0bbaf6cd1b8e45b05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7849721-0617-49d9-aa55-5c9d57647bdb', 'created_at': datetime.datetime(2026, 6, 19, 22, 7, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 7, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7849721-0617-49d9-aa55-5c9d57647bdb/file', 'properties': {}}, 'image_service': } Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Trying to clone 1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f from image a7849721-0617-49d9-aa55-5c9d57647bdb at location (None, [{'url': 'file:///opt/stack/data/glance/images/a7849721-0617-49d9-aa55-5c9d57647bdb', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:07:56 devstack sudo[132625]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7" returned: 0 in 0.674s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:56 devstack sudo[132649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.info Jun 20 00:07:56 devstack sudo[132649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:57 devstack sudo[132649]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.info" returned: 0 in 0.725s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:57 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.info is being set with open permissions: ugo+rw Jun 20 00:07:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:57 devstack sudo[132673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.info Jun 20 00:07:57 devstack sudo[132673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:58 devstack sudo[132673]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.info" returned: 0 in 0.744s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.307s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.553s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1942194773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e965795b-f906-4cd7-9962-a5afcf5038c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0321c5bb9ab4bf0bbaf6cd1b8e45b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:55Z,use_quota=True,user_id='54330e5dfad34ecfa61f6533df87ed47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8d01637-b044-4306-a30d-691c9c910329),volume_type_id=e8d01637-b044-4306-a30d-691c9c910329)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Creating volume e965795b-f906-4cd7-9962-a5afcf5038c4 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:07:58 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:07:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:58 devstack sudo[132700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 1073741824 Jun 20 00:07:58 devstack sudo[132700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:07:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-69bf87ed-da1f-48f5-9935-f4193ac93e56 tempest-SnapshotMetadataTestJSON-1647008329 None] Create snapshot completed successfully Jun 20 00:07:59 devstack sudo[132700]: pam_unix(sudo:session): session closed for user root Jun 20 00:07:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 1073741824" returned: 0 in 0.918s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:07:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:07:59 devstack sudo[132741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 Jun 20 00:07:59 devstack sudo[132741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:00 devstack sudo[132741]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4" returned: 0 in 0.698s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.725s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-279775586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03c1f4c-1bfc-4f27-9567-26aa181c1977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0321c5bb9ab4bf0bbaf6cd1b8e45b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:55Z,use_quota=True,user_id='54330e5dfad34ecfa61f6533df87ed47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0454532c-7dd5-4851-826a-04dc02d0cff1),volume_type_id=0454532c-7dd5-4851-826a-04dc02d0cff1)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Creating volume e03c1f4c-1bfc-4f27-9567-26aa181c1977 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:08:00 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:00 devstack sudo[132765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 1073741824 Jun 20 00:08:00 devstack sudo[132765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774ffad9-6add-4cfe-8681-6888a5ede6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e965795b-f906-4cd7-9962-a5afcf5038c4', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9427d29c-a44e-4dd0-a120-26482bffff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "cinder-0fcc1948-97a5-4b10-9430-74ff10db85b7-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:00 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Volume volume-e965795b-f906-4cd7-9962-a5afcf5038c4 (e965795b-f906-4cd7-9962-a5afcf5038c4): created successfully Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9427d29c-a44e-4dd0-a120-26482bffff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Flow 'volume_create_manager' (0e0959d2-7e21-49be-b49c-0e843b27ffd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-0fcc1948-97a5-4b10-9430-74ff10db85b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "cinder-quobyte-86d33f67-7115-4d99-a376-def6d723518f" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:00 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a1f559f6-ee8d-4bc6-950a-469953cf5d08 tempest-TestInstancesWithCinderVolumes-410160060 None] Created volume successfully. Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-quobyte-86d33f67-7115-4d99-a376-def6d723518f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "cinder-quobyte-0fcc1948-97a5-4b10-9430-74ff10db85b7" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-quobyte-0fcc1948-97a5-4b10-9430-74ff10db85b7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Deleting offline snapshot 0fcc1948-97a5-4b10-9430-74ff10db85b7 of volume 86d33f67-7115-4d99-a376-def6d723518f {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] snapshot_file for this snap is: volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a5741f-e511-4947-a4f2-e4a034f54f06]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD, size 20.69 MB, duration 3.94 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:08:00 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Image download 20.69 MB at 5.25 MB/s Jun 20 00:08:00 devstack sudo[132772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 Jun 20 00:08:00 devstack sudo[132772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe947d5-a2dc-4d60-8bf5-732625d9aa38]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:00 devstack sudo[132779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD Jun 20 00:08:00 devstack sudo[132779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:00 devstack sudo[132765]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 1073741824" returned: 0 in 0.883s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:01 devstack sudo[132805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 Jun 20 00:08:01 devstack sudo[132805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:01 devstack sudo[132772]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7" returned: 0 in 0.850s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86d33f67-7115-4d99-a376-def6d723518f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdd7731-2a0f-4195-ac46-b1dc7d5ceea5]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:01 devstack sudo[132779]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Temporary image a7849721-0617-49d9-aa55-5c9d57647bdb is fetched for user 54330e5dfad34ecfa61f6533df87ed47. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f44fab-ea25-411c-ac2e-877d557e0fd9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:01 devstack sudo[132813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f Jun 20 00:08:01 devstack sudo[132813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:01 devstack sudo[132817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD Jun 20 00:08:01 devstack sudo[132817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:01 devstack sudo[132805]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977" returned: 0 in 0.690s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfd1c525-91f8-480b-bcf2-11c76c3bfc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2e4dee-1090-487f-b38d-d95753e5ff44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:01 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Volume volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 (e03c1f4c-1bfc-4f27-9567-26aa181c1977): created successfully Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2e4dee-1090-487f-b38d-d95753e5ff44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Flow 'volume_create_manager' (7093c6f3-6b24-47f7-b97a-80b43aebfa15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:01 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-03788ae2-3567-47dc-abd7-7f352bd0323f tempest-TestInstancesWithCinderVolumes-410160060 None] Created volume successfully. Jun 20 00:08:01 devstack sudo[132813]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f" returned: 0 in 0.800s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:01 devstack sudo[132848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 Jun 20 00:08:01 devstack sudo[132848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:02 devstack sudo[132817]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1714984832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0321c5bb9ab4bf0bbaf6cd1b8e45b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:07:56Z,use_quota=True,user_id='54330e5dfad34ecfa61f6533df87ed47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5860666-fd7e-4ead-8616-0fa6fc54aba9),volume_type_id=e5860666-fd7e-4ead-8616-0fa6fc54aba9)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Creating volume 1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:08:02 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:02 devstack sudo[132853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f 1073741824 Jun 20 00:08:02 devstack sudo[132853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:02 devstack sudo[132848]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7" returned: 0 in 0.732s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:02 devstack sudo[132880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7 Jun 20 00:08:02 devstack sudo[132880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:02 devstack sudo[132853]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f 1073741824" returned: 0 in 0.846s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:02 devstack sudo[132891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:08:02 devstack sudo[132891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:03 devstack sudo[132880]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f.0fcc1948-97a5-4b10-9430-74ff10db85b7" returned: 0 in 0.664s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-quobyte-0fcc1948-97a5-4b10-9430-74ff10db85b7" released by "_delete_snapshot" :: held 3.156s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-quobyte-86d33f67-7115-4d99-a376-def6d723518f" released by "delete_snapshot" :: held 3.179s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Created reservations ['6fe7eae1-3a9e-4a05-a292-08cb9080c51c', '8874ed5e-9ed5-42af-8ef9-87ea0414efb2', '28891834-8985-4a42-a16e-8718d937c13c', '0c43445f-bd03-4b0d-8616-e26e19d65668'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:08:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Delete snapshot completed successfully. Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-372b4553-366a-4d5d-ab9d-bc92f68b19b5 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-0fcc1948-97a5-4b10-9430-74ff10db85b7-delete_snapshot" released by "delete_snapshot" :: held 3.349s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:03 devstack sudo[132891]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 0 in 0.642s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Attempting download of a7849721-0617-49d9-aa55-5c9d57647bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/a7849721-0617-49d9-aa55-5c9d57647bdb', 'metadata': {}}])) to volume 1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d6e0b-70ec-4785-a3af-253e66900414]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7849721-0617-49d9-aa55-5c9d57647bdb_jxi0n4jr {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:03 devstack sudo[132916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7849721-0617-49d9-aa55-5c9d57647bdb_jxi0n4jr Jun 20 00:08:03 devstack sudo[132916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:04 devstack sudo[132916]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a7849721-0617-49d9-aa55-5c9d57647bdb_jxi0n4jr" returned: 0 in 0.723s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7849721-0617-49d9-aa55-5c9d57647bdb_jxi0n4jr {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "cinder-86d33f67-7115-4d99-a376-def6d723518f-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:04 devstack sudo[132941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7849721-0617-49d9-aa55-5c9d57647bdb_jxi0n4jr Jun 20 00:08:04 devstack sudo[132941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-86d33f67-7115-4d99-a376-def6d723518f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "cinder-quobyte-86d33f67-7115-4d99-a376-def6d723518f" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-quobyte-86d33f67-7115-4d99-a376-def6d723518f" acquired by "delete_volume" :: waited 0.013s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a056e70-fe9e-40a7-baaa-5bb7c5b7cd19]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:04 devstack sudo[132949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f Jun 20 00:08:04 devstack sudo[132949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:05 devstack sudo[132941]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7849721-0617-49d9-aa55-5c9d57647bdb_jxi0n4jr" returned: 1 in 0.739s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a7849721-0617-49d9-aa55-5c9d57647bdb_jxi0n4jr' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e175544-0969-4d01-97ae-b59831f98e4e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:05 devstack sudo[132968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD Jun 20 00:08:05 devstack sudo[132968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:05 devstack sudo[132949]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f" returned: 0 in 0.749s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:05 devstack sudo[132984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f Jun 20 00:08:05 devstack sudo[132984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:05 devstack sudo[132968]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] a7849721-0617-49d9-aa55-5c9d57647bdb was qcow2, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:08:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:05 devstack sudo[133004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:08:05 devstack sudo[133004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:05 devstack sudo[132984]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86d33f67-7115-4d99-a376-def6d723518f" returned: 0 in 0.668s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-quobyte-86d33f67-7115-4d99-a376-def6d723518f" released by "delete_volume" :: held 1.474s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Created reservations ['0a983e91-b8a4-4f86-97c4-e484d0d980fd', '1515982b-6417-4aac-ba6a-1fb9f1404059', '50855169-b5cd-4741-91be-735729ef602c', '5313e680-1a25-4ab2-8324-5e9d8fb11aec'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:06 devstack sudo[133016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:08:06 devstack sudo[133016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:06 devstack sudo[133016]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.740s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:08:06 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Deleted volume successfully. Jun 20 00:08:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6fa32a75-ffd9-4de7-b079-98914c68a540 tempest-SnapshotMetadataTestJSON-1647008329 None] Lock "cinder-86d33f67-7115-4d99-a376-def6d723518f-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:07 devstack sudo[133004]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 0 in 2.106s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:07 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a7849721-0617-49d9-aa55-5c9d57647bdb_oclzhz3edevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:08:07 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Converted 112.00 MB image at 53.16 MB/s Jun 20 00:08:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:07 devstack sudo[133080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f 1G Jun 20 00:08:07 devstack sudo[133080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:08 devstack sudo[133080]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f 1G" returned: 0 in 0.780s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:08 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f71d9b-4fa1-4165-b975-3b7003f2afaa]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:08 devstack sudo[133110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:08:08 devstack sudo[133110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:09 devstack sudo[133110]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 0 in 0.787s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:09 devstack sudo[133139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:08:09 devstack sudo[133139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:10 devstack sudo[133139]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 1 in 0.753s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Downloaded image a7849721-0617-49d9-aa55-5c9d57647bdb ((None, [{'url': 'file:///opt/stack/data/glance/images/a7849721-0617-49d9-aa55-5c9d57647bdb', 'metadata': {}}])) to volume 1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Temporary image a7849721-0617-49d9-aa55-5c9d57647bdb for user 54330e5dfad34ecfa61f6533df87ed47 is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Marking volume 1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Copying metadata from image a7849721-0617-49d9-aa55-5c9d57647bdb to 1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Creating volume glance metadata for volume 1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f backed by image a7849721-0617-49d9-aa55-5c9d57647bdb with: {'image_id': 'a7849721-0617-49d9-aa55-5c9d57647bdb', 'image_name': 'tempest-scenario-img--1346643314', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1f2cd3-a6c4-4c04-ba2a-65483e218a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f', 'volume_size': 1, 'image_id': 'a7849721-0617-49d9-aa55-5c9d57647bdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a7849721-0617-49d9-aa55-5c9d57647bdb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1346643314', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c0321c5bb9ab4bf0bbaf6cd1b8e45b05', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a7849721-0617-49d9-aa55-5c9d57647bdb', 'created_at': datetime.datetime(2026, 6, 19, 22, 7, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 7, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a7849721-0617-49d9-aa55-5c9d57647bdb/file', 'properties': {}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caeb4fe6-0171-405e-ad89-c53da5dc9226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:10 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Volume volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f (1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f): created successfully Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caeb4fe6-0171-405e-ad89-c53da5dc9226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Flow 'volume_create_manager' (2f89310e-6855-40bb-a4c6-1541bea9aa89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:10 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c5918d28-4bfe-4049-bfa1-fb92675cdbaf tempest-TestInstancesWithCinderVolumes-410160060 None] Created volume successfully. Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Flow 'volume_create_manager' (9c870e87-b1e8-4161-952c-35bda3fde617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c43a7d-0c4c-4bbd-a0cc-bf4d2e2b3f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c43a7d-0c4c-4bbd-a0cc-bf4d2e2b3f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1586445375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636f3d7b-e2b8-4222-92ac-af7336514212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2cf29a7102c4a328947e4a77e4a803b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:11Z,use_quota=True,user_id='183da0fb68ef43c19d2ed7bd7dc8bf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a9da0b-69b0-4828-be66-15e584476f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a9da0b-69b0-4828-be66-15e584476f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebc42e8-62e8-4ab5-a6eb-9266f99c075c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebc42e8-62e8-4ab5-a6eb-9266f99c075c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636f3d7b-e2b8-4222-92ac-af7336514212', 'volume_name': 'volume-636f3d7b-e2b8-4222-92ac-af7336514212', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9039aa2d-faef-4c4c-b6de-70f7e1e26212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9039aa2d-faef-4c4c-b6de-70f7e1e26212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaff165-621c-497d-80b0-b004c632c0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:11 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Volume 636f3d7b-e2b8-4222-92ac-af7336514212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636f3d7b-e2b8-4222-92ac-af7336514212', 'volume_size': 1} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1586445375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636f3d7b-e2b8-4222-92ac-af7336514212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2cf29a7102c4a328947e4a77e4a803b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:11Z,use_quota=True,user_id='183da0fb68ef43c19d2ed7bd7dc8bf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Creating volume 636f3d7b-e2b8-4222-92ac-af7336514212 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:08:11 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:08:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:11 devstack sudo[133200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 1073741824 Jun 20 00:08:11 devstack sudo[133200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:12 devstack sudo[133200]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 1073741824" returned: 0 in 0.870s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:12 devstack sudo[133239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 Jun 20 00:08:12 devstack sudo[133239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:13 devstack sudo[133239]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212" returned: 0 in 0.683s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:08:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abaff165-621c-497d-80b0-b004c632c0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636f3d7b-e2b8-4222-92ac-af7336514212', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702a3df2-448d-4feb-831d-18cd17d63ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:13 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Volume volume-636f3d7b-e2b8-4222-92ac-af7336514212 (636f3d7b-e2b8-4222-92ac-af7336514212): created successfully Jun 20 00:08:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702a3df2-448d-4feb-831d-18cd17d63ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:13 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Flow 'volume_create_manager' (9c870e87-b1e8-4161-952c-35bda3fde617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:13 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-558f472b-4c23-46f6-b4e1-26b7861b0ea9 tempest-VolumesTransfersTest-228528372 None] Created volume successfully. Jun 20 00:08:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-71a7a6a9-230d-48b5-82a2-d7aa9932959a tempest-VolumesTransfersTest-1762389335 None] Transfer volume completed successfully. Jun 20 00:08:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Acquiring lock "cinder-636f3d7b-e2b8-4222-92ac-af7336514212-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Lock "cinder-636f3d7b-e2b8-4222-92ac-af7336514212-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Acquiring lock "cinder-quobyte-636f3d7b-e2b8-4222-92ac-af7336514212" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Lock "cinder-quobyte-636f3d7b-e2b8-4222-92ac-af7336514212" acquired by "delete_volume" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:15 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae2a040-3a5b-4567-9616-6c3a1f255ab8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:15 devstack sudo[133340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 Jun 20 00:08:15 devstack sudo[133340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:16 devstack sudo[133340]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212" returned: 0 in 1.034s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:16 devstack sudo[133405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212 Jun 20 00:08:16 devstack sudo[133405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:17 devstack sudo[133405]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-636f3d7b-e2b8-4222-92ac-af7336514212" returned: 0 in 0.776s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Lock "cinder-quobyte-636f3d7b-e2b8-4222-92ac-af7336514212" released by "delete_volume" :: held 1.911s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Created reservations ['b53bda7d-3f4a-472f-b78b-bb112d6433c6', 'd90c9506-f770-494c-aff1-9870c2137aa9', 'eb33c2cb-5d71-4d53-8087-a972c30f494a', 'a9c87e0d-a7ff-4155-8efb-9766e929ccf4'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:17 devstack sudo[133441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:08:17 devstack sudo[133441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Flow 'volume_create_manager' (269df5d2-ae7b-4ce5-ac9a-8f23b7a74643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1a9dc6-01ff-40d9-9581-0dad0d8501f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1a9dc6-01ff-40d9-9581-0dad0d8501f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1098862910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea92ea99-a292-4c5c-ad63-950a21cb97c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2cf29a7102c4a328947e4a77e4a803b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:18Z,use_quota=True,user_id='183da0fb68ef43c19d2ed7bd7dc8bf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cd9af0-0947-4a44-84d3-41b03ec526f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46cd9af0-0947-4a44-84d3-41b03ec526f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d932058a-da31-47d8-8235-857e38c5e35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d932058a-da31-47d8-8235-857e38c5e35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea92ea99-a292-4c5c-ad63-950a21cb97c0', 'volume_name': 'volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b876f328-6f8f-42a2-b3e1-0489f3922766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:18 devstack sudo[133441]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b876f328-6f8f-42a2-b3e1-0489f3922766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340306cb-9e49-47c7-adab-989979acedc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:18 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Volume ea92ea99-a292-4c5c-ad63-950a21cb97c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0', 'volume_size': 1} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1098862910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea92ea99-a292-4c5c-ad63-950a21cb97c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2cf29a7102c4a328947e4a77e4a803b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:18Z,use_quota=True,user_id='183da0fb68ef43c19d2ed7bd7dc8bf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Creating volume ea92ea99-a292-4c5c-ad63-950a21cb97c0 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:08:18 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:18 devstack sudo[133523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 1073741824 Jun 20 00:08:18 devstack sudo[133523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.309s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:08:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Deleted volume successfully. Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f3f66315-292a-4d9d-a92b-75c4db463ce4 tempest-VolumesTransfersTest-1388927436 None] Lock "cinder-636f3d7b-e2b8-4222-92ac-af7336514212-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-99c4c871-3cec-4012-8edd-9be93343076d tempest-TestShelveInstance-855873225 None] Terminate volume connection completed successfully. Jun 20 00:08:18 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-99c4c871-3cec-4012-8edd-9be93343076d tempest-TestShelveInstance-855873225 None] Deleting attachment 200fafb6-9610-40ac-8d05-89b9864e1313. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:08:19 devstack sudo[133523]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 1073741824" returned: 0 in 1.050s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:19 devstack sudo[133565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 Jun 20 00:08:19 devstack sudo[133565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Acquiring lock "cinder-e481d90b-684a-4094-9154-0c3b744981e3-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Lock "cinder-e481d90b-684a-4094-9154-0c3b744981e3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Acquiring lock "cinder-quobyte-e481d90b-684a-4094-9154-0c3b744981e3" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Lock "cinder-quobyte-e481d90b-684a-4094-9154-0c3b744981e3" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73112fb2-b87a-4ff0-89c0-03f2437075f1]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:19 devstack sudo[133573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:08:19 devstack sudo[133573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:20 devstack sudo[133565]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0" returned: 0 in 0.760s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.712s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (340306cb-9e49-47c7-adab-989979acedc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8492a2-7578-414b-a10b-d78e9ca0be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:20 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Volume volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 (ea92ea99-a292-4c5c-ad63-950a21cb97c0): created successfully Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8492a2-7578-414b-a10b-d78e9ca0be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Flow 'volume_create_manager' (269df5d2-ae7b-4ce5-ac9a-8f23b7a74643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01c5b26-3602-4d79-8202-b49f919a3219]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ad706b6f-b5c4-45c1-add0-64891acc37c9 tempest-VolumesTransfersTest-228528372 None] Created volume successfully. Jun 20 00:08:20 devstack sudo[133594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:08:20 devstack sudo[133594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:20 devstack sudo[133573]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 0 in 0.836s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:20 devstack sudo[133604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:08:20 devstack sudo[133604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Acquiring lock "cinder-ea92ea99-a292-4c5c-ad63-950a21cb97c0-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Lock "cinder-ea92ea99-a292-4c5c-ad63-950a21cb97c0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Acquiring lock "cinder-quobyte-ea92ea99-a292-4c5c-ad63-950a21cb97c0" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Lock "cinder-quobyte-ea92ea99-a292-4c5c-ad63-950a21cb97c0" acquired by "delete_volume" :: waited 0.039s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15185489-09e3-4f30-9fca-4447d8ee3a1a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:21 devstack sudo[133594]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 0 in 0.961s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:21 devstack sudo[133626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 Jun 20 00:08:21 devstack sudo[133626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:21 devstack sudo[133633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:08:21 devstack sudo[133633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:21 devstack sudo[133604]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 1 in 1.076s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:08:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:21 devstack sudo[133648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3 Jun 20 00:08:21 devstack sudo[133648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:22 devstack sudo[133626]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0" returned: 0 in 0.978s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:22 devstack sudo[133671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0 Jun 20 00:08:22 devstack sudo[133671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:22 devstack sudo[133633]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 1 in 0.938s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.972s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4869011-930e-4e10-a8a2-a2d57c20eaae', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:08:22 devstack sudo[133648]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e481d90b-684a-4094-9154-0c3b744981e3" returned: 0 in 0.752s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Lock "cinder-quobyte-e481d90b-684a-4094-9154-0c3b744981e3" released by "delete_volume" :: held 2.743s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:22 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-d29035e9-bfcd-4b43-b651-219ab1c8a350 req-faa9909d-6c43-41ac-975b-aa200b3c31ae tempest-TestInstancesWithCinderVolumes-410160060 None] attachment_update completed successfully. Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG cinder.quota [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Created reservations ['1c20f565-3e3f-477c-bbe3-b7d6f5fe5846', 'd9f9fefb-ab76-404e-84f2-b7d9a65f6394', '04e0dc28-c1ae-428f-8fb8-01193b648fa5', '6b47c489-adad-4f77-a1af-dc8a9e8858a6'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:22 devstack sudo[133686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:08:22 devstack sudo[133686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:22 devstack sudo[133671]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ea92ea99-a292-4c5c-ad63-950a21cb97c0" returned: 0 in 0.764s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Lock "cinder-quobyte-ea92ea99-a292-4c5c-ad63-950a21cb97c0" released by "delete_volume" :: held 1.804s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Created reservations ['251e52ea-4427-4dd5-91f5-27be416847cf', '4b1efbfe-49dc-4927-9424-66fd3a32b680', '7c035ecb-394b-4888-b94c-b148ea376be1', '9ba1664d-bd59-4f3a-809b-99125c0594b5'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:23 devstack sudo[133707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:08:23 devstack sudo[133707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:23 devstack sudo[133686]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.820s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG cinder.manager [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:08:23 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Deleted volume successfully. Jun 20 00:08:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [req-203865ca-2012-408a-8ae5-ad70e2ccdc3d req-152dff3c-8236-4ac3-b458-3c30ddea2114 tempest-TestShelveInstance-855873225 None] Lock "cinder-e481d90b-684a-4094-9154-0c3b744981e3-delete_volume" released by "delete_volume" :: held 3.869s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:24 devstack sudo[133707]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.881s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:24 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:08:24 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Deleted volume successfully. Jun 20 00:08:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fadc6299-82b7-43b8-8833-0d3019aaacf1 tempest-VolumesTransfersTest-1388927436 None] Lock "cinder-ea92ea99-a292-4c5c-ad63-950a21cb97c0-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:08:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:08:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:28 devstack sudo[134252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:08:28 devstack sudo[134252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:29 devstack sudo[134252]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.181s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:08:29 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:08:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:08:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:08:33 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=50,cinder:UPDATE=58,cinder:DELETE=4,cinder:INSERT=16 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:08:34 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=53,cinder:SELECT=49,cinder:INSERT=19,cinder:DELETE=6 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (2af40b71-dac8-4d76-af77-80b395a78f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af096ff7-a8d3-4a9f-910b-5af79ac149c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af096ff7-a8d3-4a9f-910b-5af79ac149c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1071360242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee2727f-ab72-4a1b-b629-7b9031f873b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:45Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471d4f12-bd20-4082-96b7-bb72ff3d3e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471d4f12-bd20-4082-96b7-bb72ff3d3e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfa8ca7-aa5e-4611-90a1-ea5412e39c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfa8ca7-aa5e-4611-90a1-ea5412e39c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ee2727f-ab72-4a1b-b629-7b9031f873b6', 'volume_name': 'volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273d65a7-03c1-4b14-b960-e295357fd215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (273d65a7-03c1-4b14-b960-e295357fd215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5b0a73-9b17-44bf-ab55-eb9f5c707332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume 4ee2727f-ab72-4a1b-b629-7b9031f873b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6', 'volume_size': 1} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1071360242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee2727f-ab72-4a1b-b629-7b9031f873b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:45Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Creating volume 4ee2727f-ab72-4a1b-b629-7b9031f873b6 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:08:44 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:08:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:45 devstack sudo[134855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 1073741824 Jun 20 00:08:45 devstack sudo[134855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:46 devstack sudo[134855]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 1073741824" returned: 0 in 1.275s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:46 devstack sudo[134974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 Jun 20 00:08:46 devstack sudo[134974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:47 devstack sudo[134974]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6" returned: 0 in 1.240s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] <== create_volume: return (2587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:08:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.590s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5b0a73-9b17-44bf-ab55-eb9f5c707332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24752116-6014-40f0-91ad-e7b9131b709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:47 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 (4ee2727f-ab72-4a1b-b629-7b9031f873b6): created successfully Jun 20 00:08:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24752116-6014-40f0-91ad-e7b9131b709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (2af40b71-dac8-4d76-af77-80b395a78f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:47 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7f901d6e-5985-4cd7-a490-5779a2fbf533 tempest-CreateVolumesFromSnapshotTest-382988377 None] Created volume successfully. Jun 20 00:08:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Creating offline snapshot 98989369-715e-4f12-b21e-12dc2f3bba5f of volume 4ee2727f-ab72-4a1b-b629-7b9031f873b6 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:08:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[541a2ff6-137a-4dd4-a289-588d65d5ae4f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:08:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:48 devstack sudo[135038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 Jun 20 00:08:48 devstack sudo[135038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:49 devstack sudo[135038]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6" returned: 0 in 0.928s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:49 devstack sudo[135073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f 1G Jun 20 00:08:49 devstack sudo[135073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:50 devstack sudo[135073]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f 1G" returned: 0 in 0.891s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:50 devstack sudo[135105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f Jun 20 00:08:50 devstack sudo[135105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:51 devstack sudo[135105]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f" returned: 0 in 0.900s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:51 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f is being set with open permissions: ugo+rw Jun 20 00:08:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:51 devstack sudo[135137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f Jun 20 00:08:51 devstack sudo[135137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:51 devstack sudo[135137]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f" returned: 0 in 0.749s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:51 devstack sudo[135164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.info Jun 20 00:08:51 devstack sudo[135164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:52 devstack sudo[135164]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.info" returned: 0 in 0.724s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:52 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.info is being set with open permissions: ugo+rw Jun 20 00:08:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:52 devstack sudo[135188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.info Jun 20 00:08:52 devstack sudo[135188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:53 devstack sudo[135188]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.info" returned: 0 in 0.857s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.154s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8599de16-d5fe-4b96-8cf0-97f65d75e8d0 tempest-CreateVolumesFromSnapshotTest-382988377 None] Create snapshot completed successfully Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (5d935a28-7558-48ce-90cb-d1caf2813dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5381d0ef-b3e6-4bbd-8133-6670c78414c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5381d0ef-b3e6-4bbd-8133-6670c78414c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-35979557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bc6b37-0dfe-4af4-a79d-feb4369668ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:55Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b178b5-9bd2-4669-8186-2cb367c6882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b178b5-9bd2-4669-8186-2cb367c6882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be11d576-3ff5-49b1-a03f-d602266f4333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be11d576-3ff5-49b1-a03f-d602266f4333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9bc6b37-0dfe-4af4-a79d-feb4369668ff', 'volume_name': 'volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fea4bb-f872-4761-8640-68626ec1f32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36fea4bb-f872-4761-8640-68626ec1f32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c5afc4-a37e-446d-9169-b758c30dc108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:55 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume c9bc6b37-0dfe-4af4-a79d-feb4369668ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff', 'volume_size': 1} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-35979557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bc6b37-0dfe-4af4-a79d-feb4369668ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:55Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Creating volume c9bc6b37-0dfe-4af4-a79d-feb4369668ff {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:08:55 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:55 devstack sudo[135276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff 1073741824 Jun 20 00:08:55 devstack sudo[135276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (5af629e4-2b00-4b75-bf37-b6e03156ec49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e438941-369f-4dd8-a59a-4e3a9a2b1ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e438941-369f-4dd8-a59a-4e3a9a2b1ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467625968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952e0c83-1641-49df-9ce3-2b35ae7a7e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:56Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e6e075-f808-41e8-9298-788bef88805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e6e075-f808-41e8-9298-788bef88805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:55 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce803486-da28-4436-b30b-7fc2443ef02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce803486-da28-4436-b30b-7fc2443ef02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '952e0c83-1641-49df-9ce3-2b35ae7a7e4c', 'volume_name': 'volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8055946b-95a6-4c24-841e-c56f02212473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8055946b-95a6-4c24-841e-c56f02212473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba51324-0efe-4658-88dc-e79e56ef9384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:56 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume 952e0c83-1641-49df-9ce3-2b35ae7a7e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c', 'volume_size': 1} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (c0fb7b2e-2551-4aef-8044-66af9e0b63d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9cbc3-4bf9-4134-b584-60978d05a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9cbc3-4bf9-4134-b584-60978d05a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1049944653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c098acd-c1aa-40d2-9478-c65276a965ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:56Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8998e9-85ed-4ff1-975f-863dc76cb7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8998e9-85ed-4ff1-975f-863dc76cb7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6089c944-9189-45c4-a56c-05efc45ee0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6089c944-9189-45c4-a56c-05efc45ee0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c098acd-c1aa-40d2-9478-c65276a965ee', 'volume_name': 'volume-7c098acd-c1aa-40d2-9478-c65276a965ee', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7f77d9-847b-42a0-b749-ea3f564ae2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7f77d9-847b-42a0-b749-ea3f564ae2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e31e06-1e37-44f6-9cbc-9cdc0f4366db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:56 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume 7c098acd-c1aa-40d2-9478-c65276a965ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c098acd-c1aa-40d2-9478-c65276a965ee', 'volume_size': 1} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:56 devstack sudo[135276]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff 1073741824" returned: 0 in 1.294s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:56 devstack sudo[135327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff Jun 20 00:08:56 devstack sudo[135327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:08:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (3cba2365-cf17-4b99-8997-62459992abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bead1d-9ac1-46da-9977-87d44c2a7e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bead1d-9ac1-46da-9977-87d44c2a7e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217370355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295e2327-5b7b-44d6-b082-27b06c4eb2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:57Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5e7b2c-a6ac-4f1d-a402-6b5f1f54ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5e7b2c-a6ac-4f1d-a402-6b5f1f54ec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f6cd12-cc29-4058-83ae-8edd4d69efdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f6cd12-cc29-4058-83ae-8edd4d69efdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295e2327-5b7b-44d6-b082-27b06c4eb2bd', 'volume_name': 'volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552d5d4c-5cd5-4a49-a9d2-88f24a147332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552d5d4c-5cd5-4a49-a9d2-88f24a147332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181f62b4-265c-4698-88c6-b842f2191c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume 295e2327-5b7b-44d6-b082-27b06c4eb2bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd', 'volume_size': 1} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (1bef0a30-8edf-4220-9ca3-57ea86ba15a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f24e674-6458-4eae-ba73-92918b9da416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f24e674-6458-4eae-ba73-92918b9da416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547346142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2384189f-5368-4ff4-bc60-1dc9dcf21088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:57Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c173de2f-a000-4ab4-811c-b90635f06e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c173de2f-a000-4ab4-811c-b90635f06e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df95d4ea-d919-475a-9588-1887ea1d4ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df95d4ea-d919-475a-9588-1887ea1d4ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2384189f-5368-4ff4-bc60-1dc9dcf21088', 'volume_name': 'volume-2384189f-5368-4ff4-bc60-1dc9dcf21088', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcfd838-2da7-4cc0-9ad9-6ddb4b5edbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fcfd838-2da7-4cc0-9ad9-6ddb4b5edbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f43f74-624e-4d55-9045-ecfc45adfef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume 2384189f-5368-4ff4-bc60-1dc9dcf21088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2384189f-5368-4ff4-bc60-1dc9dcf21088', 'volume_size': 1} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:57 devstack sudo[135327]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff" returned: 0 in 0.876s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1467625968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952e0c83-1641-49df-9ce3-2b35ae7a7e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:56Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Creating volume 952e0c83-1641-49df-9ce3-2b35ae7a7e4c {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:08:57 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c5afc4-a37e-446d-9169-b758c30dc108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack sudo[135362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c 1073741824 Jun 20 00:08:57 devstack sudo[135362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b965eba-6c18-4bf4-a88e-d44ac3750758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:57 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff (c9bc6b37-0dfe-4af4-a79d-feb4369668ff): created successfully Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b965eba-6c18-4bf4-a88e-d44ac3750758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (5d935a28-7558-48ce-90cb-d1caf2813dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f5deab23-ad12-4fe7-b452-281155168e8b tempest-CreateVolumesFromSnapshotTest-382988377 None] Created volume successfully. Jun 20 00:08:58 devstack sudo[135362]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c 1073741824" returned: 0 in 0.923s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:58 devstack sudo[135396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c Jun 20 00:08:58 devstack sudo[135396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:59 devstack sudo[135396]: pam_unix(sudo:session): session closed for user root Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c" returned: 0 in 0.705s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.745s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1049944653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c098acd-c1aa-40d2-9478-c65276a965ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:56Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Creating volume 7c098acd-c1aa-40d2-9478-c65276a965ee {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:08:59 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba51324-0efe-4658-88dc-e79e56ef9384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16ba3c6-a501-4311-889b-0b2acfa1ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:08:59 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c (952e0c83-1641-49df-9ce3-2b35ae7a7e4c): created successfully Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16ba3c6-a501-4311-889b-0b2acfa1ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:08:59 devstack sudo[135426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee 1073741824 Jun 20 00:08:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (5af629e4-2b00-4b75-bf37-b6e03156ec49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:08:59 devstack sudo[135426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:08:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-71ecd125-f1ac-4390-8cab-ac5af9647ac3 tempest-CreateVolumesFromSnapshotTest-382988377 None] Created volume successfully. Jun 20 00:09:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-9ae8f698-2824-4c69-9db3-ae9b964d15c5 req-bb562211-dad1-47d7-9b60-3deccdb2312f tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:00 devstack sudo[135426]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee 1073741824" returned: 0 in 1.007s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:00 devstack sudo[135476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee Jun 20 00:09:00 devstack sudo[135476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:01 devstack sudo[135476]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee" returned: 0 in 0.653s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.937s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-217370355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295e2327-5b7b-44d6-b082-27b06c4eb2bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:57Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Creating volume 295e2327-5b7b-44d6-b082-27b06c4eb2bd {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:01 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:01 devstack sudo[135497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd 1073741824 Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e31e06-1e37-44f6-9cbc-9cdc0f4366db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c098acd-c1aa-40d2-9478-c65276a965ee', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:01 devstack sudo[135497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bd1118-2709-4271-bd61-68490487bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:01 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume volume-7c098acd-c1aa-40d2-9478-c65276a965ee (7c098acd-c1aa-40d2-9478-c65276a965ee): created successfully Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bd1118-2709-4271-bd61-68490487bd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (c0fb7b2e-2551-4aef-8044-66af9e0b63d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:01 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-aa1ed5a4-5345-407e-b30a-e117093cc34d tempest-CreateVolumesFromSnapshotTest-382988377 None] Created volume successfully. Jun 20 00:09:01 devstack sudo[135497]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd 1073741824" returned: 0 in 0.882s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:02 devstack sudo[135530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd Jun 20 00:09:02 devstack sudo[135530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:02 devstack sudo[135530]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd" returned: 0 in 0.670s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.240s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1547346142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2384189f-5368-4ff4-bc60-1dc9dcf21088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a6617bd144b422b91a2c71b175176b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:08:57Z,use_quota=True,user_id='adfe00734a3a4fa4992a640a925d748d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Creating volume 2384189f-5368-4ff4-bc60-1dc9dcf21088 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:02 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:02 devstack sudo[135554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 1073741824 Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181f62b4-265c-4698-88c6-b842f2191c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:02 devstack sudo[135554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4eca40-9f5c-4c14-addd-91e41e0c89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:02 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd (295e2327-5b7b-44d6-b082-27b06c4eb2bd): created successfully Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4eca40-9f5c-4c14-addd-91e41e0c89a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (3cba2365-cf17-4b99-8997-62459992abd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-24b5726e-7938-49d1-9dac-94607d431aee tempest-CreateVolumesFromSnapshotTest-382988377 None] Created volume successfully. Jun 20 00:09:03 devstack sudo[135554]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 1073741824" returned: 0 in 0.862s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:03 devstack sudo[135587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 Jun 20 00:09:03 devstack sudo[135587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:04 devstack sudo[135587]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088" returned: 0 in 0.685s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-9ae8f698-2824-4c69-9db3-ae9b964d15c5 req-bb562211-dad1-47d7-9b60-3deccdb2312f tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.940s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f43f74-624e-4d55-9045-ecfc45adfef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2384189f-5368-4ff4-bc60-1dc9dcf21088', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bc9dd7-c5a3-483b-9086-732c59bbc722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49122f6b-1fff-42ed-8343-e858bb399bb0]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-9ae8f698-2824-4c69-9db3-ae9b964d15c5 req-bb562211-dad1-47d7-9b60-3deccdb2312f tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:04 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Volume volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 (2384189f-5368-4ff4-bc60-1dc9dcf21088): created successfully Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bc9dd7-c5a3-483b-9086-732c59bbc722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:04 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Flow 'volume_create_manager' (1bef0a30-8edf-4220-9ca3-57ea86ba15a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c7e934b7-40ec-4840-9fac-187c43a0c619 tempest-CreateVolumesFromSnapshotTest-382988377 None] Created volume successfully. Jun 20 00:09:04 devstack sudo[135611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 Jun 20 00:09:04 devstack sudo[135611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-2384189f-5368-4ff4-bc60-1dc9dcf21088-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-2384189f-5368-4ff4-bc60-1dc9dcf21088-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-quobyte-2384189f-5368-4ff4-bc60-1dc9dcf21088" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-2384189f-5368-4ff4-bc60-1dc9dcf21088" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eb0461-d3bb-4342-bdd6-325179ccf713]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:05 devstack sudo[135611]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-9ae8f698-2824-4c69-9db3-ae9b964d15c5 req-bb562211-dad1-47d7-9b60-3deccdb2312f tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4" returned: 0 in 1.023s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-9ae8f698-2824-4c69-9db3-ae9b964d15c5 req-bb562211-dad1-47d7-9b60-3deccdb2312f tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-9ae8f698-2824-4c69-9db3-ae9b964d15c5 req-bb562211-dad1-47d7-9b60-3deccdb2312f tempest-TestInstancesWithCinderVolumes-410160060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-e965795b-f906-4cd7-9962-a5afcf5038c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '444d03ce-827b-4879-9b9f-13c7bd72597d', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:09:05 devstack sudo[135643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 Jun 20 00:09:05 devstack sudo[135643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-9ae8f698-2824-4c69-9db3-ae9b964d15c5 req-bb562211-dad1-47d7-9b60-3deccdb2312f tempest-TestInstancesWithCinderVolumes-410160060 None] attachment_update completed successfully. Jun 20 00:09:06 devstack sudo[135643]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088" returned: 0 in 0.842s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:06 devstack sudo[135679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088 Jun 20 00:09:06 devstack sudo[135679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:06 devstack sudo[135679]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-2384189f-5368-4ff4-bc60-1dc9dcf21088" returned: 0 in 0.930s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-2384189f-5368-4ff4-bc60-1dc9dcf21088" released by "delete_volume" :: held 1.830s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Created reservations ['4cbf7d49-4fbe-40a7-8a9c-79b74f2f7fb1', 'd0f64dc9-f498-43da-9bc1-351ebf905d4a', '0e91242c-c4ab-4776-8a44-73c5c4a52635', 'e374a111-45aa-422f-94ce-628247cf5113'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:07 devstack sudo[135732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:07 devstack sudo[135732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-295e2327-5b7b-44d6-b082-27b06c4eb2bd-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-295e2327-5b7b-44d6-b082-27b06c4eb2bd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-quobyte-295e2327-5b7b-44d6-b082-27b06c4eb2bd" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-295e2327-5b7b-44d6-b082-27b06c4eb2bd" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af137e10-2036-4fef-8d87-c1cb8939a4ac]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:07 devstack sudo[135749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd Jun 20 00:09:07 devstack sudo[135749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:07 devstack sudo[135732]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.712s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Deleted volume successfully. Jun 20 00:09:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-52f25384-ca75-4404-b06d-7ae5d8dd533d tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-2384189f-5368-4ff4-bc60-1dc9dcf21088-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:08 devstack sudo[135749]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd" returned: 0 in 0.814s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:08 devstack sudo[135780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd Jun 20 00:09:08 devstack sudo[135780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:09 devstack sudo[135780]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-295e2327-5b7b-44d6-b082-27b06c4eb2bd" returned: 0 in 0.668s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-295e2327-5b7b-44d6-b082-27b06c4eb2bd" released by "delete_volume" :: held 1.545s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Created reservations ['68bdf9cc-a18c-4d6d-81fd-d0038af19dfd', 'f5d361c8-08bb-4019-90f9-b20af165db86', 'f3d78cdf-32fc-4004-91b3-73612e8573d8', '953caafe-fe60-46fe-80f8-a2ca19786be1'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:09 devstack sudo[135808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:09 devstack sudo[135808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-7c098acd-c1aa-40d2-9478-c65276a965ee-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-7c098acd-c1aa-40d2-9478-c65276a965ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-quobyte-7c098acd-c1aa-40d2-9478-c65276a965ee" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-7c098acd-c1aa-40d2-9478-c65276a965ee" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f2721f-beb4-4888-bdfa-c6f535fd0c82]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:09 devstack sudo[135808]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.673s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Deleted volume successfully. Jun 20 00:09:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-012ac2f3-3cae-4fa3-a19a-e0767bf05bbe tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-295e2327-5b7b-44d6-b082-27b06c4eb2bd-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:09 devstack sudo[135829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee Jun 20 00:09:09 devstack sudo[135829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:10 devstack sudo[135829]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee" returned: 0 in 0.801s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:10 devstack sudo[135865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee Jun 20 00:09:10 devstack sudo[135865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:11 devstack sudo[135865]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c098acd-c1aa-40d2-9478-c65276a965ee" returned: 0 in 0.635s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-7c098acd-c1aa-40d2-9478-c65276a965ee" released by "delete_volume" :: held 1.478s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Created reservations ['bd9ed891-a2c2-4ee7-a04f-9c747761dcef', '668ac070-535f-423b-ab9a-56a8cf7151bb', '4e27a7f7-08d4-43c2-99a9-4dc4f3fa1b2d', '7e2de44e-3701-4390-aa14-c0bd5cd5048c'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:11 devstack sudo[135899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:11 devstack sudo[135899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-952e0c83-1641-49df-9ce3-2b35ae7a7e4c-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-952e0c83-1641-49df-9ce3-2b35ae7a7e4c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-quobyte-952e0c83-1641-49df-9ce3-2b35ae7a7e4c" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-952e0c83-1641-49df-9ce3-2b35ae7a7e4c" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36684714-ec03-4579-be3d-7bf32c6db56c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:12 devstack sudo[135899]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.733s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:12 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Deleted volume successfully. Jun 20 00:09:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-5c004a72-107f-4b10-bb09-ad8776825037 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-7c098acd-c1aa-40d2-9478-c65276a965ee-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:12 devstack sudo[135931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c Jun 20 00:09:12 devstack sudo[135931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:13 devstack sudo[135931]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c" returned: 0 in 1.001s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:13 devstack sudo[136026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c Jun 20 00:09:13 devstack sudo[136026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:14 devstack sudo[136026]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-952e0c83-1641-49df-9ce3-2b35ae7a7e4c" returned: 0 in 0.970s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-952e0c83-1641-49df-9ce3-2b35ae7a7e4c" released by "delete_volume" :: held 2.038s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7e19d311-46c8-4268-9c9c-9c7efafd91b5 req-64df388d-9307-418d-9e14-5371eb120391 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7e19d311-46c8-4268-9c9c-9c7efafd91b5 req-64df388d-9307-418d-9e14-5371eb120391 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Created reservations ['13ffbe50-dbe2-42b8-909c-be104f3a55e8', '4e3385ef-640a-4e3a-b4e4-65d6a5f97e90', '6fae3bee-bf22-40fd-b4d4-8070eb9b3520', 'b80b35e0-cd34-4be3-a760-ed8c78e13495'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad89c7-1394-42b3-82c0-5e48ed18e59d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-7e19d311-46c8-4268-9c9c-9c7efafd91b5 req-64df388d-9307-418d-9e14-5371eb120391 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:14 devstack sudo[136090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:14 devstack sudo[136090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:14 devstack sudo[136084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 Jun 20 00:09:14 devstack sudo[136084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:15 devstack sudo[136090]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.778s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:15 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Deleted volume successfully. Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-80c8f649-aa2c-4e0b-b8ad-476c6723acb4 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-952e0c83-1641-49df-9ce3-2b35ae7a7e4c-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:15 devstack sudo[136084]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-7e19d311-46c8-4268-9c9c-9c7efafd91b5 req-64df388d-9307-418d-9e14-5371eb120391 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977" returned: 0 in 0.955s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-7e19d311-46c8-4268-9c9c-9c7efafd91b5 req-64df388d-9307-418d-9e14-5371eb120391 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.987s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-7e19d311-46c8-4268-9c9c-9c7efafd91b5 req-64df388d-9307-418d-9e14-5371eb120391 tempest-TestInstancesWithCinderVolumes-410160060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '465b038d-cbc0-4baa-b9ba-2b3f17d1e8f5', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:09:15 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-7e19d311-46c8-4268-9c9c-9c7efafd91b5 req-64df388d-9307-418d-9e14-5371eb120391 tempest-TestInstancesWithCinderVolumes-410160060 None] attachment_update completed successfully. Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-c9bc6b37-0dfe-4af4-a79d-feb4369668ff-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-c9bc6b37-0dfe-4af4-a79d-feb4369668ff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-quobyte-c9bc6b37-0dfe-4af4-a79d-feb4369668ff" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-c9bc6b37-0dfe-4af4-a79d-feb4369668ff" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e70b0ec-81bc-43d3-82c5-06e1ba677e64]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:15 devstack sudo[136134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff Jun 20 00:09:15 devstack sudo[136134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:16 devstack sudo[136134]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff" returned: 0 in 0.935s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:16 devstack sudo[136172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff Jun 20 00:09:16 devstack sudo[136172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:17 devstack sudo[136172]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c9bc6b37-0dfe-4af4-a79d-feb4369668ff" returned: 0 in 0.756s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-c9bc6b37-0dfe-4af4-a79d-feb4369668ff" released by "delete_volume" :: held 1.791s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Created reservations ['d896e6bd-add4-4cff-ab1b-bd08adbbc258', '087236aa-d150-4ee9-a242-10781f0ab252', 'c446d9d3-71d9-4d9e-8cdb-415474431b3d', '859cd863-4239-4e38-926c-ed4b62655b62'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:17 devstack sudo[136210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:17 devstack sudo[136210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-98989369-715e-4f12-b21e-12dc2f3bba5f-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-98989369-715e-4f12-b21e-12dc2f3bba5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-quobyte-4ee2727f-ab72-4a1b-b629-7b9031f873b6" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-4ee2727f-ab72-4a1b-b629-7b9031f873b6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-quobyte-98989369-715e-4f12-b21e-12dc2f3bba5f" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-98989369-715e-4f12-b21e-12dc2f3bba5f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Deleting offline snapshot 98989369-715e-4f12-b21e-12dc2f3bba5f of volume 4ee2727f-ab72-4a1b-b629-7b9031f873b6 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] snapshot_file for this snap is: volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9da1a5-9b8d-435b-b451-fccefa14ad11]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:18 devstack sudo[136228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f Jun 20 00:09:18 devstack sudo[136228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:18 devstack sudo[136210]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.870s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:18 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Deleted volume successfully. Jun 20 00:09:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6507ea57-eea0-43a1-9232-a22456e0dfa6 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-c9bc6b37-0dfe-4af4-a79d-feb4369668ff-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:19 devstack sudo[136228]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f" returned: 0 in 1.114s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:09:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f62a18f-ba6a-4aef-adca-bec3dad50145]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:19 devstack sudo[136269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 Jun 20 00:09:19 devstack sudo[136269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:19 devstack sudo[136269]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6" returned: 0 in 0.895s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:19 devstack sudo[136337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f Jun 20 00:09:19 devstack sudo[136337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:20 devstack sudo[136337]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f" returned: 0 in 0.853s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:20 devstack sudo[136378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f Jun 20 00:09:20 devstack sudo[136378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:21 devstack sudo[136378]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6.98989369-715e-4f12-b21e-12dc2f3bba5f" returned: 0 in 0.718s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-98989369-715e-4f12-b21e-12dc2f3bba5f" released by "_delete_snapshot" :: held 3.725s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-4ee2727f-ab72-4a1b-b629-7b9031f873b6" released by "delete_snapshot" :: held 3.757s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:21 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Created reservations ['deb44b3e-ad3f-4b62-9e90-386c11b82ebc', 'e2b400f4-650d-4fca-88d4-0df55654eb4f', 'fb262119-79e9-496e-8f45-7e09a7ea3f11', 'cb313d60-25a9-4b4c-99d0-fd8db85a179a'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Delete snapshot completed successfully. Jun 20 00:09:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-66deaab8-0faa-4dde-9513-6313d15fe8ac tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-98989369-715e-4f12-b21e-12dc2f3bba5f-delete_snapshot" released by "delete_snapshot" :: held 3.931s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-4ee2727f-ab72-4a1b-b629-7b9031f873b6-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-4ee2727f-ab72-4a1b-b629-7b9031f873b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "cinder-quobyte-4ee2727f-ab72-4a1b-b629-7b9031f873b6" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-4ee2727f-ab72-4a1b-b629-7b9031f873b6" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:22 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c29bfac-99fe-48be-8964-c159ebd6570a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:22 devstack sudo[136423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 Jun 20 00:09:22 devstack sudo[136423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:23 devstack sudo[136423]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6" returned: 0 in 0.839s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:23 devstack sudo[136465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6 Jun 20 00:09:23 devstack sudo[136465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:23 devstack sudo[136465]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-4ee2727f-ab72-4a1b-b629-7b9031f873b6" returned: 0 in 0.675s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-quobyte-4ee2727f-ab72-4a1b-b629-7b9031f873b6" released by "delete_volume" :: held 1.597s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Created reservations ['48f5c54d-8de0-4e5e-88fd-960224f66241', 'e761df5e-d73d-4384-a6c2-1aecdda41223', '988dff91-160c-4119-ab13-e365b2a4456e', '76b75d9a-530b-42d0-809f-3d9266fcfa64'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:23 devstack sudo[136505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:23 devstack sudo[136505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:24 devstack sudo[136505]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.670s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:24 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:24 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Deleted volume successfully. Jun 20 00:09:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39746095-e6db-49d3-8f8d-fcc16ff9e787 tempest-CreateVolumesFromSnapshotTest-382988377 None] Lock "cinder-4ee2727f-ab72-4a1b-b629-7b9031f873b6-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:25 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-d563f7c6-34ab-4957-94b7-7d7120e1447c req-7e47de8e-8c0a-424d-9af7-142c4781eacf tempest-TestInstancesWithCinderVolumes-410160060 None] Terminate volume connection completed successfully. Jun 20 00:09:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-d563f7c6-34ab-4957-94b7-7d7120e1447c req-7e47de8e-8c0a-424d-9af7-142c4781eacf tempest-TestInstancesWithCinderVolumes-410160060 None] Deleting attachment 444d03ce-827b-4879-9b9f-13c7bd72597d. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "cinder-e965795b-f906-4cd7-9962-a5afcf5038c4-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-e965795b-f906-4cd7-9962-a5afcf5038c4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "cinder-quobyte-e965795b-f906-4cd7-9962-a5afcf5038c4" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-quobyte-e965795b-f906-4cd7-9962-a5afcf5038c4" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd0382b-557e-49cc-8680-4335d3789726]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:27 devstack sudo[136636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 Jun 20 00:09:27 devstack sudo[136636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (05982583-ac4d-4ba5-93c5-41e9d4953ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f330afb-6837-440d-9ab2-6df73887bbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f330afb-6837-440d-9ab2-6df73887bbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-965120960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210fe879-2922-4d46-882d-749e077531e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:28Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab45f603-1d7b-4c1f-bdc9-7be3577c5452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab45f603-1d7b-4c1f-bdc9-7be3577c5452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ad3d01-cd97-4b92-adc4-b8a610cbaae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ad3d01-cd97-4b92-adc4-b8a610cbaae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210fe879-2922-4d46-882d-749e077531e2', 'volume_name': 'volume-210fe879-2922-4d46-882d-749e077531e2', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a6b434-2b87-4e0b-9f37-1e174cf2e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a6b434-2b87-4e0b-9f37-1e174cf2e641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e83dabc-85ca-4615-ba88-c529fca4d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:27 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume 210fe879-2922-4d46-882d-749e077531e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210fe879-2922-4d46-882d-749e077531e2', 'volume_size': 1} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-965120960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210fe879-2922-4d46-882d-749e077531e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:28Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Creating volume 210fe879-2922-4d46-882d-749e077531e2 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:27 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:27 devstack sudo[136647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 1073741824 Jun 20 00:09:27 devstack sudo[136647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:28 devstack sudo[136658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:28 devstack sudo[136658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:28 devstack sudo[136636]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4" returned: 0 in 0.886s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:28 devstack sudo[136674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4 Jun 20 00:09:28 devstack sudo[136674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:28 devstack sudo[136647]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 1073741824" returned: 0 in 0.995s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:28 devstack sudo[136690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 Jun 20 00:09:28 devstack sudo[136690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:28 devstack sudo[136658]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.866s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:09:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:09:29 devstack sudo[136674]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e965795b-f906-4cd7-9962-a5afcf5038c4" returned: 0 in 0.738s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-quobyte-e965795b-f906-4cd7-9962-a5afcf5038c4" released by "delete_volume" :: held 1.682s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:29 devstack cinder-volume[93391]: WARNING cinder.quota [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1681116270-1448870922 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1681116270-1448870922, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:09:29 devstack cinder-volume[93391]: WARNING cinder.quota [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1681116270-1448870922 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1681116270-1448870922, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Created reservations ['0583c3c9-df67-40ce-b776-5656e86a5f26', '456b817e-aa28-41d0-a917-416fd0e801aa', '6486638b-9850-4619-aec1-ee4b4600be8c', 'dac19a34-bc4d-43be-ae83-df4d52a1c9a2'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:29 devstack sudo[136709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:29 devstack sudo[136709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:29 devstack sudo[136690]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2" returned: 0 in 0.741s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e83dabc-85ca-4615-ba88-c529fca4d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210fe879-2922-4d46-882d-749e077531e2', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f70a511-3b85-45fd-a20f-da7e0fe13379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:29 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume volume-210fe879-2922-4d46-882d-749e077531e2 (210fe879-2922-4d46-882d-749e077531e2): created successfully Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f70a511-3b85-45fd-a20f-da7e0fe13379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (05982583-ac4d-4ba5-93c5-41e9d4953ae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:29 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-eb9f7ecb-668c-4b9e-9b85-afebc3a06b14 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created volume successfully. Jun 20 00:09:29 devstack sudo[136709]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.718s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:29 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Deleted volume successfully. Jun 20 00:09:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b1f771b6-b2a9-47a1-bbd7-9f013c89ca15 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-e965795b-f906-4cd7-9962-a5afcf5038c4-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (9fc6978a-c2a0-42fa-a937-83a4f5371e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49915cd-941f-4913-8f83-92e30736500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49915cd-941f-4913-8f83-92e30736500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400568238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e143018-9e16-4c63-9f88-b9ef8b3bd82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:30Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de9e36a-3402-4ca6-a41b-09b2173afd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de9e36a-3402-4ca6-a41b-09b2173afd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cbb976-e0b5-4034-8c46-fc8a7507ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cbb976-e0b5-4034-8c46-fc8a7507ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e143018-9e16-4c63-9f88-b9ef8b3bd82c', 'volume_name': 'volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c88c4a-0316-470c-94da-aee8c50ada8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c88c4a-0316-470c-94da-aee8c50ada8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc071380-f7c1-4faa-9a4a-8018439264a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume 1e143018-9e16-4c63-9f88-b9ef8b3bd82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c', 'volume_size': 1} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1400568238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e143018-9e16-4c63-9f88-b9ef8b3bd82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:30Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Creating volume 1e143018-9e16-4c63-9f88-b9ef8b3bd82c {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:30 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:30 devstack sudo[136761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c 1073741824 Jun 20 00:09:30 devstack sudo[136761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (c2b17067-6beb-4a60-8c99-d7f66ded00e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a117a0b9-47de-4b40-8a96-4308bfa0f2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a117a0b9-47de-4b40-8a96-4308bfa0f2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1486757166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9107a4-adf3-481f-99aa-56f38853036b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:31Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a9b217-6fe5-48d8-ac33-c90fcba4b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a9b217-6fe5-48d8-ac33-c90fcba4b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06405ab-62d1-4fc5-8572-4ef54b2cbfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06405ab-62d1-4fc5-8572-4ef54b2cbfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c9107a4-adf3-481f-99aa-56f38853036b', 'volume_name': 'volume-0c9107a4-adf3-481f-99aa-56f38853036b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a253ba5d-dec9-476f-b6a4-9ca9b3a4e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a253ba5d-dec9-476f-b6a4-9ca9b3a4e93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d540c0-c985-413c-8972-a941a12d6733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:30 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume 0c9107a4-adf3-481f-99aa-56f38853036b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c9107a4-adf3-481f-99aa-56f38853036b', 'volume_size': 1} Jun 20 00:09:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (5830c9d6-c26b-4084-865b-13a68ae520ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199df1b8-e3fc-46c9-8df1-bdce497c9635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199df1b8-e3fc-46c9-8df1-bdce497c9635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852529993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c36525a-208a-44bb-8358-418319d9b0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:31Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b57d60-c309-4f7c-ac0a-b8c8787804c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b57d60-c309-4f7c-ac0a-b8c8787804c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925ffeab-ce65-46b1-8dd4-e8a5971c6ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925ffeab-ce65-46b1-8dd4-e8a5971c6ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c36525a-208a-44bb-8358-418319d9b0f7', 'volume_name': 'volume-0c36525a-208a-44bb-8358-418319d9b0f7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f1a542-0e60-4d8d-ac88-3d684b49f28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f1a542-0e60-4d8d-ac88-3d684b49f28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99864c92-196a-4620-ac17-b3ddfdbe0e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume 0c36525a-208a-44bb-8358-418319d9b0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c36525a-208a-44bb-8358-418319d9b0f7', 'volume_size': 1} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:31 devstack sudo[136761]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c 1073741824" returned: 0 in 1.057s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:31 devstack sudo[136802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c Jun 20 00:09:31 devstack sudo[136802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (d149a000-1382-4c04-b8db-b2c4049ac7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78da0168-7ee0-4853-89ee-0235f1ff5d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78da0168-7ee0-4853-89ee-0235f1ff5d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-961612785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315ef1ca-5788-4144-9224-2b32eaae125f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:31Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e9e998-69b3-48d3-9705-9a8ddff5e4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e9e998-69b3-48d3-9705-9a8ddff5e4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7293416-fb97-4fae-b0ed-de28bc011267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7293416-fb97-4fae-b0ed-de28bc011267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315ef1ca-5788-4144-9224-2b32eaae125f', 'volume_name': 'volume-315ef1ca-5788-4144-9224-2b32eaae125f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203e43c3-2d49-4b47-9098-2fc1a1182846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203e43c3-2d49-4b47-9098-2fc1a1182846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e97369f-b5e4-4e40-bd5c-6e8b596d2e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume 315ef1ca-5788-4144-9224-2b32eaae125f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315ef1ca-5788-4144-9224-2b32eaae125f', 'volume_size': 1} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (1a2d61aa-29a0-45be-9519-46770da46a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88ad778-165e-474e-8609-599671cca480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88ad778-165e-474e-8609-599671cca480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407826779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74f465a-2f76-43c2-b6fa-b179130ecd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:32Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bbfbd9-b2ee-42a0-9af6-3d6f18197a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bbfbd9-b2ee-42a0-9af6-3d6f18197a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf64a0c-1e14-45bd-9f1a-bbd4017a5a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf64a0c-1e14-45bd-9f1a-bbd4017a5a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b74f465a-2f76-43c2-b6fa-b179130ecd18', 'volume_name': 'volume-b74f465a-2f76-43c2-b6fa-b179130ecd18', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b67000-3f67-4fd9-9f5e-2cb3525c6beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b67000-3f67-4fd9-9f5e-2cb3525c6beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6248bd-592f-4aa1-a0cc-e1a60fd06a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:31 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume b74f465a-2f76-43c2-b6fa-b179130ecd18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b74f465a-2f76-43c2-b6fa-b179130ecd18', 'volume_size': 1} Jun 20 00:09:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:32 devstack sudo[136802]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c" returned: 0 in 0.805s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1486757166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9107a4-adf3-481f-99aa-56f38853036b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:31Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Creating volume 0c9107a4-adf3-481f-99aa-56f38853036b {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:32 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc071380-f7c1-4faa-9a4a-8018439264a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:32 devstack sudo[136831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b 1073741824 Jun 20 00:09:32 devstack sudo[136831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419b78ef-75fc-46b8-9fd4-f9ac22914068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:32 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c (1e143018-9e16-4c63-9f88-b9ef8b3bd82c): created successfully Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (419b78ef-75fc-46b8-9fd4-f9ac22914068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (9fc6978a-c2a0-42fa-a937-83a4f5371e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d61fd37d-af6f-48f2-a046-7e0d1cfc5680 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created volume successfully. Jun 20 00:09:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-960a6d57-4ee7-4ed5-a290-774f121bc90b req-8a7c2e33-d0a1-4792-8159-7b908a17e77c tempest-TestInstancesWithCinderVolumes-410160060 None] Terminate volume connection completed successfully. Jun 20 00:09:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-960a6d57-4ee7-4ed5-a290-774f121bc90b req-8a7c2e33-d0a1-4792-8159-7b908a17e77c tempest-TestInstancesWithCinderVolumes-410160060 None] Deleting attachment 465b038d-cbc0-4baa-b9ba-2b3f17d1e8f5. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:09:33 devstack sudo[136831]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b 1073741824" returned: 0 in 0.844s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:33 devstack sudo[136867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b Jun 20 00:09:33 devstack sudo[136867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:33 devstack sudo[136867]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b" returned: 0 in 0.651s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.532s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852529993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c36525a-208a-44bb-8358-418319d9b0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:31Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Creating volume 0c36525a-208a-44bb-8358-418319d9b0f7 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:33 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:33 devstack sudo[136891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 1073741824 Jun 20 00:09:33 devstack sudo[136891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d540c0-c985-413c-8972-a941a12d6733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9107a4-adf3-481f-99aa-56f38853036b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73c34b1-c6b8-4d44-b70f-256642ed3597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:33 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume volume-0c9107a4-adf3-481f-99aa-56f38853036b (0c9107a4-adf3-481f-99aa-56f38853036b): created successfully Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e73c34b1-c6b8-4d44-b70f-256642ed3597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (c2b17067-6beb-4a60-8c99-d7f66ded00e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:33 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-724dd877-5c5b-4232-8af8-107e8bd13d8c tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created volume successfully. Jun 20 00:09:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "cinder-e03c1f4c-1bfc-4f27-9567-26aa181c1977-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-e03c1f4c-1bfc-4f27-9567-26aa181c1977-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "cinder-quobyte-e03c1f4c-1bfc-4f27-9567-26aa181c1977" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:34 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-quobyte-e03c1f4c-1bfc-4f27-9567-26aa181c1977" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:34 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b47dce-336e-43f3-980d-18cf853d26a9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:34 devstack sudo[136918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 Jun 20 00:09:34 devstack sudo[136918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:34 devstack sudo[136891]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 1073741824" returned: 0 in 1.021s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:34 devstack sudo[136929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 Jun 20 00:09:34 devstack sudo[136929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:35 devstack sudo[136918]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977" returned: 0 in 1.007s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:35 devstack sudo[136956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977 Jun 20 00:09:35 devstack sudo[136956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:35 devstack sudo[136929]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7" returned: 0 in 0.829s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.988s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-961612785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315ef1ca-5788-4144-9224-2b32eaae125f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:31Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Creating volume 315ef1ca-5788-4144-9224-2b32eaae125f {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:35 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:35 devstack sudo[136966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f 1073741824 Jun 20 00:09:35 devstack sudo[136966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99864c92-196a-4620-ac17-b3ddfdbe0e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c36525a-208a-44bb-8358-418319d9b0f7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ecb033-31f3-48de-874c-f6bcc9c95115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:35 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume volume-0c36525a-208a-44bb-8358-418319d9b0f7 (0c36525a-208a-44bb-8358-418319d9b0f7): created successfully Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ecb033-31f3-48de-874c-f6bcc9c95115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (5830c9d6-c26b-4084-865b-13a68ae520ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:35 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ac2366a8-e771-44f6-9fbd-bc2223c81ec4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created volume successfully. Jun 20 00:09:36 devstack sudo[136956]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e03c1f4c-1bfc-4f27-9567-26aa181c1977" returned: 0 in 1.018s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-quobyte-e03c1f4c-1bfc-4f27-9567-26aa181c1977" released by "delete_volume" :: held 2.089s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:36 devstack cinder-volume[93391]: WARNING cinder.quota [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-591246390-2016881765 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-591246390-2016881765, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:09:36 devstack cinder-volume[93391]: WARNING cinder.quota [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-591246390-2016881765 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-591246390-2016881765, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Created reservations ['ac27c090-8645-46bb-90a5-99e3e33bea1a', '2a2afc89-d7aa-417f-a061-cbd2361cd175', '45e137af-192d-40ad-82c3-f5e8738d8780', '9ea8b6f0-c1b4-4fd7-ad7c-6fdcfd30d5b4'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:36 devstack sudo[137003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:36 devstack sudo[137003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:36 devstack sudo[136966]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f 1073741824" returned: 0 in 1.184s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:36 devstack sudo[137011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f Jun 20 00:09:36 devstack sudo[137011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:37 devstack sudo[137003]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.858s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:37 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Deleted volume successfully. Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c82f297-360e-469b-8eef-57c4c1c97e69 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-e03c1f4c-1bfc-4f27-9567-26aa181c1977-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:37 devstack sudo[137011]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f" returned: 0 in 0.765s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.659s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-407826779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b74f465a-2f76-43c2-b6fa-b179130ecd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a6ccdb967da401f9ebf56488e653d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:32Z,use_quota=True,user_id='b6fe47a79f1546718dd4afc908659fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Creating volume b74f465a-2f76-43c2-b6fa-b179130ecd18 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:37 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e97369f-b5e4-4e40-bd5c-6e8b596d2e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315ef1ca-5788-4144-9224-2b32eaae125f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:37 devstack sudo[137041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 1073741824 Jun 20 00:09:37 devstack sudo[137041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf81da5-ae44-4a1c-9dd6-a30d4f785872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume volume-315ef1ca-5788-4144-9224-2b32eaae125f (315ef1ca-5788-4144-9224-2b32eaae125f): created successfully Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf81da5-ae44-4a1c-9dd6-a30d4f785872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (d149a000-1382-4c04-b8db-b2c4049ac7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:37 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-826d1d62-8a89-41a7-968f-0f1e0cacc38f tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created volume successfully. Jun 20 00:09:38 devstack sudo[137041]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 1073741824" returned: 0 in 1.056s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:38 devstack sudo[137104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 Jun 20 00:09:38 devstack sudo[137104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:39 devstack sudo[137104]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18" returned: 0 in 0.854s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6248bd-592f-4aa1-a0cc-e1a60fd06a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74f465a-2f76-43c2-b6fa-b179130ecd18', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1aa8c7b-45b7-4958-b522-5e668a81619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:39 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Volume volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 (b74f465a-2f76-43c2-b6fa-b179130ecd18): created successfully Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1aa8c7b-45b7-4958-b522-5e668a81619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Flow 'volume_create_manager' (1a2d61aa-29a0-45be-9519-46770da46a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e1a9ad32-e691-40b6-87a8-544ef7bb41f4 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created volume successfully. Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Flow 'volume_create_manager' (756f257a-d7e5-4882-b3d7-5737f39d223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd682e1-289a-45ee-8f20-9565f3704f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-b74f465a-2f76-43c2-b6fa-b179130ecd18-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd682e1-289a-45ee-8f20-9565f3704f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-482830117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b24c717f9646afafe5b09d4fd5a77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:40Z,use_quota=True,user_id='c937c14617f7447cbe349fac4ef0f1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88da2765-0111-4e5e-9c65-3a26c9f0916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88da2765-0111-4e5e-9c65-3a26c9f0916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac34380-a28c-4aa9-93df-1e835f0b4b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac34380-a28c-4aa9-93df-1e835f0b4b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f', 'volume_name': 'volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd51b87d-4ce0-4920-980b-f9e610071cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd51b87d-4ce0-4920-980b-f9e610071cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9053b6e-79e6-4f47-abd0-740598ecea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:39 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Volume 86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f', 'volume_size': 1} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-482830117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b24c717f9646afafe5b09d4fd5a77c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:40Z,use_quota=True,user_id='c937c14617f7447cbe349fac4ef0f1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Creating volume 86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:39 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-b74f465a-2f76-43c2-b6fa-b179130ecd18-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:39 devstack sudo[137153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f 1073741824 Jun 20 00:09:39 devstack sudo[137153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-quobyte-b74f465a-2f76-43c2-b6fa-b179130ecd18" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-b74f465a-2f76-43c2-b6fa-b179130ecd18" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35609cff-a073-4a85-b561-f4152a1a53da]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:40 devstack sudo[137159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 Jun 20 00:09:40 devstack sudo[137159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:40 devstack sudo[137159]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18" returned: 0 in 0.877s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:40 devstack sudo[137153]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f 1073741824" returned: 0 in 1.006s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:40 devstack sudo[137196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18 Jun 20 00:09:40 devstack sudo[137196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:40 devstack sudo[137198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f Jun 20 00:09:40 devstack sudo[137198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:41 devstack sudo[137196]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b74f465a-2f76-43c2-b6fa-b179130ecd18" returned: 0 in 0.675s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-b74f465a-2f76-43c2-b6fa-b179130ecd18" released by "delete_volume" :: held 1.611s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:41 devstack sudo[137198]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f" returned: 0 in 0.679s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created reservations ['113e6f00-d1bc-4f9b-854b-4c5dd5922ead', '3b20cb6f-49e7-4d72-8a39-ffe80700c0d8', '1dae24fd-8d62-42ed-b770-8424f687c2d9', '094b0e60-a8b6-48de-bf0d-dd36ade08444'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9053b6e-79e6-4f47-abd0-740598ecea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735b7892-140c-4b93-b51d-2295bc2a975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:41 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Volume volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f (86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f): created successfully Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735b7892-140c-4b93-b51d-2295bc2a975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Flow 'volume_create_manager' (756f257a-d7e5-4882-b3d7-5737f39d223f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:41 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a15443d6-2f06-4505-bf7a-411285483d92 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Created volume successfully. Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:41 devstack sudo[137226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:41 devstack sudo[137226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:41 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-a87fc4c1-7b25-44b1-a44e-f35870ae4674 req-6ee22030-3540-4ea3-8d0a-1d175a6570dd tempest-TestInstancesWithCinderVolumes-410160060 None] Terminate volume connection completed successfully. Jun 20 00:09:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-a87fc4c1-7b25-44b1-a44e-f35870ae4674 req-6ee22030-3540-4ea3-8d0a-1d175a6570dd tempest-TestInstancesWithCinderVolumes-410160060 None] Deleting attachment b4869011-930e-4e10-a8a2-a2d57c20eaae. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-315ef1ca-5788-4144-9224-2b32eaae125f-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-315ef1ca-5788-4144-9224-2b32eaae125f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-quobyte-315ef1ca-5788-4144-9224-2b32eaae125f" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-315ef1ca-5788-4144-9224-2b32eaae125f" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ca90d-b405-42d9-b302-174055beebfa]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:42 devstack sudo[137244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f Jun 20 00:09:42 devstack sudo[137244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:42 devstack sudo[137226]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.677s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:42 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Deleted volume successfully. Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3267146b-657b-4832-a083-1b4a8fed88e2 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-b74f465a-2f76-43c2-b6fa-b179130ecd18-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:42 devstack sudo[137244]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f" returned: 0 in 0.804s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:42 devstack sudo[137273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f Jun 20 00:09:42 devstack sudo[137273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:43 devstack sudo[137273]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-315ef1ca-5788-4144-9224-2b32eaae125f" returned: 0 in 0.639s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-315ef1ca-5788-4144-9224-2b32eaae125f" released by "delete_volume" :: held 1.488s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=86,cinder:UPDATE=122,cinder:DELETE=12,cinder:INSERT=25 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created reservations ['714d14c3-dca3-4157-b51b-e4b6c265f037', '379db1cf-73cc-4b33-980a-50ba13674112', '81479141-762f-4cc7-b6d9-6d3d96385fd0', '112959c3-8aca-49b9-9259-bed820d57564'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:43 devstack sudo[137300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:43 devstack sudo[137300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-0c36525a-208a-44bb-8358-418319d9b0f7-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-0c36525a-208a-44bb-8358-418319d9b0f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=112,cinder:UPDATE=128,cinder:INSERT=33,cinder:DELETE=11 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-quobyte-0c36525a-208a-44bb-8358-418319d9b0f7" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-0c36525a-208a-44bb-8358-418319d9b0f7" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6d22d5-2367-4ee5-bea0-f855b4e66195]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:44 devstack sudo[137300]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.690s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Deleted volume successfully. Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d28cb36a-830d-43e8-85d4-b66265fca115 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-315ef1ca-5788-4144-9224-2b32eaae125f-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:44 devstack sudo[137324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 Jun 20 00:09:44 devstack sudo[137324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "cinder-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "cinder-quobyte-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-quobyte-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-2f4dddc1-ce2d-47a9-8c2a-f4d5bc2a6a2b req-b40b73ae-c9ad-4208-aac2-d34129a8a8f6 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-2f4dddc1-ce2d-47a9-8c2a-f4d5bc2a6a2b req-b40b73ae-c9ad-4208-aac2-d34129a8a8f6 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4656ffeb-088c-4184-a793-ca2a54d09250]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0665064-ff33-48ad-82b4-129b31827328]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-2f4dddc1-ce2d-47a9-8c2a-f4d5bc2a6a2b req-b40b73ae-c9ad-4208-aac2-d34129a8a8f6 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:45 devstack sudo[137352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:09:45 devstack sudo[137352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:45 devstack sudo[137353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f Jun 20 00:09:45 devstack sudo[137353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:45 devstack sudo[137324]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7" returned: 0 in 0.890s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:45 devstack sudo[137368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7 Jun 20 00:09:45 devstack sudo[137368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:45 devstack sudo[137352]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 0 in 0.807s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:45 devstack sudo[137353]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-2f4dddc1-ce2d-47a9-8c2a-f4d5bc2a6a2b req-b40b73ae-c9ad-4208-aac2-d34129a8a8f6 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f" returned: 0 in 0.812s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-2f4dddc1-ce2d-47a9-8c2a-f4d5bc2a6a2b req-b40b73ae-c9ad-4208-aac2-d34129a8a8f6 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.835s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:45 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-2f4dddc1-ce2d-47a9-8c2a-f4d5bc2a6a2b req-b40b73ae-c9ad-4208-aac2-d34129a8a8f6 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd5ae11d-5c91-4659-b655-9f44e18dcb44', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:09:45 devstack sudo[137391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:09:45 devstack sudo[137391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:45 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-2f4dddc1-ce2d-47a9-8c2a-f4d5bc2a6a2b req-b40b73ae-c9ad-4208-aac2-d34129a8a8f6 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] attachment_update completed successfully. Jun 20 00:09:46 devstack sudo[137368]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c36525a-208a-44bb-8358-418319d9b0f7" returned: 0 in 0.712s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-0c36525a-208a-44bb-8358-418319d9b0f7" released by "delete_volume" :: held 1.665s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created reservations ['4a78474c-4363-4810-b708-d3184f8fe258', 'b7cb8eb8-e561-4d06-ac43-09a8ab201e33', 'af1ec8b3-85aa-481c-8e94-48d76dd7e61c', 'e5b93c2d-9317-4aca-8ec5-e01869f655e9'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:46 devstack sudo[137459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:46 devstack sudo[137459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-0c9107a4-adf3-481f-99aa-56f38853036b-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-0c9107a4-adf3-481f-99aa-56f38853036b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-quobyte-0c9107a4-adf3-481f-99aa-56f38853036b" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-0c9107a4-adf3-481f-99aa-56f38853036b" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e9bb3-a5d3-491b-a26d-3df5eaf573c6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:46 devstack sudo[137391]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 1 in 0.927s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:46 devstack sudo[137498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b Jun 20 00:09:46 devstack sudo[137498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:46 devstack sudo[137502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f Jun 20 00:09:46 devstack sudo[137502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:46 devstack sudo[137459]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.761s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:46 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:46 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Deleted volume successfully. Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c3d7bd2b-e81e-4083-908f-51f0588b5ab9 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-0c36525a-208a-44bb-8358-418319d9b0f7-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:47 devstack sudo[137502]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" returned: 0 in 0.721s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-quobyte-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f" released by "delete_volume" :: held 2.537s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:47 devstack sudo[137498]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b" returned: 0 in 0.856s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:47 devstack sudo[137852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b Jun 20 00:09:47 devstack sudo[137852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:47 devstack cinder-volume[93391]: WARNING cinder.quota [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2031577104-1591528523 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2031577104-1591528523, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:09:47 devstack cinder-volume[93391]: WARNING cinder.quota [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2031577104-1591528523 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2031577104-1591528523, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Created reservations ['2e845c93-31d0-4d8a-b05f-43b357b47ff3', 'af1f15ba-dfdd-4cb2-a968-f19d0385c58e', 'b27926a3-d290-4113-9940-9ea5e434a3ea', 'd9d6bca7-2d12-4ade-a42d-dd6a9192a2d2'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:47 devstack sudo[137857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:47 devstack sudo[137857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:48 devstack sudo[137852]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-0c9107a4-adf3-481f-99aa-56f38853036b" returned: 0 in 0.687s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-0c9107a4-adf3-481f-99aa-56f38853036b" released by "delete_volume" :: held 1.590s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created reservations ['ee287bec-d0c4-4342-bae9-72f1208c8c74', '166727b4-4c85-4b70-b664-e8f4e05f308f', '1776b18d-52a9-4a38-8236-875b5e2bb96e', '23479c59-dedb-4455-8cec-e4b8eb9a60ab'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:48 devstack sudo[137857]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.665s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:48 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Deleted volume successfully. Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dbfefedd-ab22-4130-bfee-d71a6c78ee51 tempest-TestInstancesWithCinderVolumes-410160060 None] Lock "cinder-1c54afe6-a9b0-4f7f-a9cc-281de8b21f5f-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:48 devstack sudo[137882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:48 devstack sudo[137882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-1e143018-9e16-4c63-9f88-b9ef8b3bd82c-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-1e143018-9e16-4c63-9f88-b9ef8b3bd82c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-quobyte-1e143018-9e16-4c63-9f88-b9ef8b3bd82c" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-1e143018-9e16-4c63-9f88-b9ef8b3bd82c" acquired by "delete_volume" :: waited 0.038s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df3054b-57b5-4752-92ee-2ebc39c265c9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:49 devstack sudo[137882]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.732s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:49 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:49 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Deleted volume successfully. Jun 20 00:09:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bf852863-eedf-4624-9a7d-d124d213f158 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-0c9107a4-adf3-481f-99aa-56f38853036b-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:49 devstack sudo[137903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c Jun 20 00:09:49 devstack sudo[137903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:49 devstack sudo[137903]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c" returned: 0 in 0.809s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:49 devstack sudo[137932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c Jun 20 00:09:49 devstack sudo[137932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:50 devstack sudo[137932]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1e143018-9e16-4c63-9f88-b9ef8b3bd82c" returned: 0 in 0.786s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-1e143018-9e16-4c63-9f88-b9ef8b3bd82c" released by "delete_volume" :: held 1.652s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created reservations ['f4ca023c-3cf5-4efc-9929-1718dcf54b4d', 'a3a600e7-e38d-4ac6-bd23-4e619f4194eb', '41df1bcc-62ce-4315-ac6c-61d36ae254d9', 'e63c9911-517e-40b6-bee9-ddd102bcd17f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:50 devstack sudo[137965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:50 devstack sudo[137965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-210fe879-2922-4d46-882d-749e077531e2-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-210fe879-2922-4d46-882d-749e077531e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "cinder-quobyte-210fe879-2922-4d46-882d-749e077531e2" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-210fe879-2922-4d46-882d-749e077531e2" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6e23bf-09b8-4d65-b521-6b24078b901f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:51 devstack sudo[137983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 Jun 20 00:09:51 devstack sudo[137983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:51 devstack sudo[137965]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.801s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Deleted volume successfully. Jun 20 00:09:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-65a10012-a8fc-40e2-8374-a4f02efc5067 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-1e143018-9e16-4c63-9f88-b9ef8b3bd82c-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:52 devstack sudo[137983]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2" returned: 0 in 0.840s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:52 devstack sudo[138015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2 Jun 20 00:09:52 devstack sudo[138015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:52 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-ed51100a-4d45-4329-92b8-91aeaf4116e4 req-a0682e88-4a7e-4aca-8baa-d9810a2b2f45 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Terminate volume connection completed successfully. Jun 20 00:09:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-ed51100a-4d45-4329-92b8-91aeaf4116e4 req-a0682e88-4a7e-4aca-8baa-d9810a2b2f45 tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Deleting attachment bd5ae11d-5c91-4659-b655-9f44e18dcb44. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:09:52 devstack sudo[138015]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-210fe879-2922-4d46-882d-749e077531e2" returned: 0 in 0.847s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-quobyte-210fe879-2922-4d46-882d-749e077531e2" released by "delete_volume" :: held 1.744s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Created reservations ['4bdbe194-7fec-40e2-a300-6aba18297bb5', 'd1294a6c-60fe-4c99-9456-8064c952e564', 'a4319210-1ec2-4c10-8ab5-58f15b0f66ac', '49e9f1db-166d-4998-a166-237c2121eb6b'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:53 devstack sudo[138077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:53 devstack sudo[138077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:53 devstack sudo[138077]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.795s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Deleted volume successfully. Jun 20 00:09:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3ad24a91-d5ae-421b-8cab-a2794de67387 tempest-CreateVolumesFromSourceVolumeTest-1496362402 None] Lock "cinder-210fe879-2922-4d46-882d-749e077531e2-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Acquiring lock "cinder-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "cinder-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Acquiring lock "cinder-quobyte-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:09:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "cinder-quobyte-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:09:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf642b8-3cea-4b94-a4ef-917f444c8f57]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:09:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:54 devstack sudo[138129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f Jun 20 00:09:54 devstack sudo[138129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:55 devstack sudo[138129]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f" returned: 0 in 0.926s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:55 devstack sudo[138163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f Jun 20 00:09:55 devstack sudo[138163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:56 devstack sudo[138163]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f" returned: 0 in 0.722s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "cinder-quobyte-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f" released by "delete_volume" :: held 1.713s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Created reservations ['c9be4cde-41d1-4606-8c80-9aef8622b8c3', '64ba5f41-0074-458a-bd8f-1f9a66378bdc', '47697e18-4681-41e4-833d-b90b1415b6bb', '93c99ff6-f062-498d-9da5-46b58be8b832'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:56 devstack sudo[138193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:09:56 devstack sudo[138193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:56 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Flow 'volume_create_manager' (02b145c5-212f-4cac-b289-3af3ba2fd16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb2cd13-6e56-4a6d-8f14-253281084440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fb2cd13-6e56-4a6d-8f14-253281084440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb99501-ece4-4621-a2ce-3a3f14c0d654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0f921b6d374a9d8ebd09c4008bb7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:57Z,use_quota=True,user_id='3669e15220f34b01acab9d4cf88df9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0cbad4-3907-45d2-894a-ad8e63857b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d0cbad4-3907-45d2-894a-ad8e63857b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afb2626-b326-4597-899a-cedbd8d2b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afb2626-b326-4597-899a-cedbd8d2b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb99501-ece4-4621-a2ce-3a3f14c0d654', 'volume_name': 'volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4514e408-2e18-4860-a891-04c2b837e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4514e408-2e18-4860-a891-04c2b837e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92010fdb-786d-4d81-8afd-39f6e98c071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:57 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Volume 1eb99501-ece4-4621-a2ce-3a3f14c0d654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654', 'volume_size': 1} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb99501-ece4-4621-a2ce-3a3f14c0d654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0f921b6d374a9d8ebd09c4008bb7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:09:57Z,use_quota=True,user_id='3669e15220f34b01acab9d4cf88df9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Creating volume 1eb99501-ece4-4621-a2ce-3a3f14c0d654 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:09:57 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:57 devstack sudo[138213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 1073741824 Jun 20 00:09:57 devstack sudo[138213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:57 devstack sudo[138193]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.923s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:09:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Deleted volume successfully. Jun 20 00:09:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ca72ae3d-7189-40d0-a91a-c2a8c936b88b tempest-TestServerVolumeAttachScenarioOldVersion-41795821 None] Lock "cinder-86534ac3-f7f5-4bac-86e0-9d4dcdaf1d8f-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:09:58 devstack sudo[138213]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 1073741824" returned: 0 in 1.050s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:09:58 devstack sudo[138263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 Jun 20 00:09:58 devstack sudo[138263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:09:59 devstack sudo[138263]: pam_unix(sudo:session): session closed for user root Jun 20 00:09:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654" returned: 0 in 0.911s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:09:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:09:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:09:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92010fdb-786d-4d81-8afd-39f6e98c071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603b2f3b-56dc-4ac0-9700-700db4ffad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:09:59 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Volume volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 (1eb99501-ece4-4621-a2ce-3a3f14c0d654): created successfully Jun 20 00:09:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603b2f3b-56dc-4ac0-9700-700db4ffad69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:09:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Flow 'volume_create_manager' (02b145c5-212f-4cac-b289-3af3ba2fd16d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:09:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-76adab71-c6f9-4e3e-8f9f-955fbceb68e4 tempest-CinderUnicodeTest-370295101 None] Created volume successfully. Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Flow 'volume_create_manager' (20aaa0a0-93e6-4095-868c-59eea4437b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2ce895-6293-4b7e-a307-da4141e65e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2ce895-6293-4b7e-a307-da4141e65e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:10:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1505749248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0f921b6d374a9d8ebd09c4008bb7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:10:01Z,use_quota=True,user_id='3669e15220f34b01acab9d4cf88df9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26b6069-894c-40b3-b358-2a01844797fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26b6069-894c-40b3-b358-2a01844797fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041b9907-bb64-4176-a4c9-037bd3bf06d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041b9907-bb64-4176-a4c9-037bd3bf06d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b', 'volume_name': 'volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975aad50-53d9-4cbd-a982-d719bb659ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975aad50-53d9-4cbd-a982-d719bb659ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb5f43e-a67a-4b21-bb35-34d9b236299c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:01 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Volume 1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b', 'volume_size': 1} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:10:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1505749248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0f921b6d374a9d8ebd09c4008bb7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:10:01Z,use_quota=True,user_id='3669e15220f34b01acab9d4cf88df9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Creating volume 1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:10:01 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:01 devstack sudo[138383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b 1073741824 Jun 20 00:10:01 devstack sudo[138383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:01 devstack sudo[138383]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b 1073741824" returned: 0 in 0.957s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:02 devstack sudo[138419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b Jun 20 00:10:02 devstack sudo[138419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:02 devstack sudo[138419]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" returned: 0 in 0.661s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:02 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:10:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb5f43e-a67a-4b21-bb35-34d9b236299c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc89c48b-1d6a-44af-8e30-eb47f7d687f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:02 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Volume volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b (1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b): created successfully Jun 20 00:10:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc89c48b-1d6a-44af-8e30-eb47f7d687f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Flow 'volume_create_manager' (20aaa0a0-93e6-4095-868c-59eea4437b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:10:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1b8d23b9-7032-4da1-b39b-6e299beeba02 tempest-CinderUnicodeTest-370295101 None] Created volume successfully. Jun 20 00:10:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:04 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Creating offline snapshot 476e682b-990f-45c5-bbb0-492f0e4308c8 of volume 1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:10:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff88692-d040-4a56-9560-0fe28fa16189]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:04 devstack sudo[138488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b Jun 20 00:10:04 devstack sudo[138488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:04 devstack sudo[138488]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" returned: 0 in 0.764s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:04 devstack sudo[138514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 1G Jun 20 00:10:04 devstack sudo[138514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:05 devstack sudo[138514]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 1G" returned: 0 in 0.965s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:05 devstack sudo[138550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 Jun 20 00:10:05 devstack sudo[138550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:06 devstack sudo[138550]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8" returned: 0 in 0.775s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:06 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 is being set with open permissions: ugo+rw Jun 20 00:10:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:06 devstack sudo[138579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 Jun 20 00:10:06 devstack sudo[138579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:07 devstack sudo[138579]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8" returned: 0 in 0.882s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:07 devstack sudo[138681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.info Jun 20 00:10:07 devstack sudo[138681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:08 devstack sudo[138681]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.info" returned: 0 in 1.042s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:08 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.info is being set with open permissions: ugo+rw Jun 20 00:10:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:08 devstack sudo[139031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.info Jun 20 00:10:08 devstack sudo[139031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:09 devstack sudo[139031]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.info" returned: 0 in 0.840s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.410s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-65bfc44b-b488-4f40-b814-4aad866ba444 tempest-CinderUnicodeTest-370295101 None] Create snapshot completed successfully Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "cinder-476e682b-990f-45c5-bbb0-492f0e4308c8-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-476e682b-990f-45c5-bbb0-492f0e4308c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "cinder-quobyte-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-quobyte-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "cinder-quobyte-476e682b-990f-45c5-bbb0-492f0e4308c8" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-quobyte-476e682b-990f-45c5-bbb0-492f0e4308c8" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Deleting offline snapshot 476e682b-990f-45c5-bbb0-492f0e4308c8 of volume 1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] snapshot_file for this snap is: volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ccad2-cd80-449b-89ed-05780bf74a56]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:10 devstack sudo[139140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 Jun 20 00:10:10 devstack sudo[139140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:12 devstack sudo[139140]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8" returned: 0 in 1.309s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:10:12 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39be702-1fe2-4cfd-b05c-c988d5c1b3dd]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:12 devstack sudo[139217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b Jun 20 00:10:12 devstack sudo[139217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:13 devstack sudo[139217]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" returned: 0 in 1.215s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:13 devstack sudo[139283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 Jun 20 00:10:13 devstack sudo[139283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:14 devstack sudo[139283]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8" returned: 0 in 1.118s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:14 devstack sudo[139348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8 Jun 20 00:10:14 devstack sudo[139348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:15 devstack sudo[139348]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b.476e682b-990f-45c5-bbb0-492f0e4308c8" returned: 0 in 0.917s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-quobyte-476e682b-990f-45c5-bbb0-492f0e4308c8" released by "_delete_snapshot" :: held 4.747s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-quobyte-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" released by "delete_snapshot" :: held 4.816s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:15 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Created reservations ['b1ff833b-ab27-4bb3-b918-d56580fea981', '737b1926-e538-4d2a-a43c-ebf4aca6c5f6', 'def4fdb1-5747-4423-8d11-18d39cedab0c', 'e626a8a3-0e01-453a-8d2a-6aa1663fe966'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:10:15 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Delete snapshot completed successfully. Jun 20 00:10:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3e4b194f-eb7b-4818-a0d6-3b2b3e2f6529 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-476e682b-990f-45c5-bbb0-492f0e4308c8-delete_snapshot" released by "delete_snapshot" :: held 5.087s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "cinder-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "cinder-quobyte-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-quobyte-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:16 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c70687-1a35-424e-838a-dddd6e79cf48]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:16 devstack sudo[139439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b Jun 20 00:10:16 devstack sudo[139439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:17 devstack sudo[139439]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" returned: 0 in 1.394s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:17 devstack sudo[139535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b Jun 20 00:10:17 devstack sudo[139535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:18 devstack sudo[139535]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" returned: 0 in 0.758s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-quobyte-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b" released by "delete_volume" :: held 2.234s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Created reservations ['5826b77d-d9f8-4dfc-ab6f-91516b727ec2', '58fbdb50-7c45-4049-aa7c-5607b92d4495', '6006a793-3191-472a-9548-b70e6568b99a', 'a19641f4-d991-483a-afb7-14857249bd1c'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:18 devstack sudo[139586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:10:18 devstack sudo[139586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:19 devstack sudo[139586]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.791s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:10:19 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Deleted volume successfully. Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0e83ce90-d5f2-4a86-bf49-c446e0df6557 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-1ed37fd1-2cf6-4e78-9a58-8c7f7a44600b-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "cinder-1eb99501-ece4-4621-a2ce-3a3f14c0d654-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-1eb99501-ece4-4621-a2ce-3a3f14c0d654-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "cinder-quobyte-1eb99501-ece4-4621-a2ce-3a3f14c0d654" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-quobyte-1eb99501-ece4-4621-a2ce-3a3f14c0d654" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d89d2d8-9ae5-4e98-91d3-5dde7331aa6f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:19 devstack sudo[139619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 Jun 20 00:10:19 devstack sudo[139619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:20 devstack sudo[139619]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654" returned: 0 in 1.095s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:20 devstack sudo[139693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654 Jun 20 00:10:20 devstack sudo[139693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:21 devstack sudo[139693]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-1eb99501-ece4-4621-a2ce-3a3f14c0d654" returned: 0 in 0.706s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-quobyte-1eb99501-ece4-4621-a2ce-3a3f14c0d654" released by "delete_volume" :: held 1.847s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Created reservations ['cb7e6a24-1cc9-461b-b9cb-1e7134638cb9', 'a8a466ff-f128-42a4-876c-4c0931a80a82', 'b3a01e22-bb95-474c-9cfd-874df8be1974', '74811cd6-fb7c-49ee-8589-4232c10e43ec'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:21 devstack sudo[139723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:10:21 devstack sudo[139723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:22 devstack sudo[139723]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.842s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:22 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:10:22 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Deleted volume successfully. Jun 20 00:10:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcff389a-c85f-4187-b31b-932bf06ad042 tempest-CinderUnicodeTest-370295101 None] Lock "cinder-1eb99501-ece4-4621-a2ce-3a3f14c0d654-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:24 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:10:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Flow 'volume_create_manager' (5f666203-cc92-48af-8b12-66e090e4a4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:10:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471194d7-be1e-4d72-963d-5ca8f0e3156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471194d7-be1e-4d72-963d-5ca8f0e3156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51530ea-c981-4d1b-a851-3f0f76a1caf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8045fa8bf514536afc785cf72bb6ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:10:24Z,use_quota=True,user_id='f50e48b888b8494485cd09bef706f0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442427c6-5433-4978-81f8-f2638cb7e061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442427c6-5433-4978-81f8-f2638cb7e061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:24 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dca99ff-d964-4eef-8216-340c42ab353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:24 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:10:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dca99ff-d964-4eef-8216-340c42ab353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd51530ea-c981-4d1b-a851-3f0f76a1caf8', 'volume_name': 'volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8', 'volume_size': 1, 'image_id': '5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37fd63d803dbf33be950c645262ff1e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8045fa8bf514536afc785cf72bb6ca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed2e9c068a07e4a97cb0805f45af641269cae8c0c2271926730c74b717b7e9b46fe284e55fec1dfc6dbbc93da3d0b50624264ac24d2ac0873d516a12910107f8', 'id': '5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'created_at': datetime.datetime(2026, 6, 19, 22, 10, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12/file', 'properties': {}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734fab24-6c5e-43be-a3b3-fce924652f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (734fab24-6c5e-43be-a3b3-fce924652f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:25 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852bf9c9-fe16-48e4-874a-bb3c3583a11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:25 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Volume d51530ea-c981-4d1b-a851-3f0f76a1caf8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8', 'volume_size': 1, 'image_id': '5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37fd63d803dbf33be950c645262ff1e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8045fa8bf514536afc785cf72bb6ca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed2e9c068a07e4a97cb0805f45af641269cae8c0c2271926730c74b717b7e9b46fe284e55fec1dfc6dbbc93da3d0b50624264ac24d2ac0873d516a12910107f8', 'id': '5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'created_at': datetime.datetime(2026, 6, 19, 22, 10, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12/file', 'properties': {}}, 'image_service': } Jun 20 00:10:25 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Trying to clone d51530ea-c981-4d1b-a851-3f0f76a1caf8 from image 5ad48b2f-16e2-4b04-93c3-60bc0432df12 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:10:25 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:10:25 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Image download 0.00 MB at 0.00 MB/s Jun 20 00:10:25 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d933312-5816-4d0a-8d11-60ca97137003]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:25 devstack sudo[139837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD Jun 20 00:10:25 devstack sudo[139837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:26 devstack sudo[139837]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:26 devstack sudo[139869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD Jun 20 00:10:26 devstack sudo[139869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:26 devstack sudo[139869]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD" returned: 1 in 0.877s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:10:26 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Temporary image 5ad48b2f-16e2-4b04-93c3-60bc0432df12 is fetched for user f50e48b888b8494485cd09bef706f0c4. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:10:27 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c53cc29-0f92-41f2-a03a-99c32e145a41]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:27 devstack sudo[139902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD Jun 20 00:10:27 devstack sudo[139902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:27 devstack sudo[139902]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:28 devstack sudo[139930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD Jun 20 00:10:28 devstack sudo[139930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:28 devstack sudo[139938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:10:28 devstack sudo[139938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:28 devstack sudo[139938]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.819s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:10:28 devstack sudo[139930]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD" returned: 1 in 1.037s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51530ea-c981-4d1b-a851-3f0f76a1caf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8045fa8bf514536afc785cf72bb6ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:10:24Z,use_quota=True,user_id='f50e48b888b8494485cd09bef706f0c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Creating volume d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:10:28 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:10:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:28 devstack sudo[139971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 1073741824 Jun 20 00:10:28 devstack sudo[139971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:29 devstack sudo[139971]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 1073741824" returned: 0 in 1.017s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:30 devstack sudo[140009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 Jun 20 00:10:30 devstack sudo[140009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:30 devstack sudo[140009]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8" returned: 0 in 0.914s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:30 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:10:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:30 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Attempting download of 5ad48b2f-16e2-4b04-93c3-60bc0432df12 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'metadata': {}}])) to volume d51530ea-c981-4d1b-a851-3f0f76a1caf8. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:10:31 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ace9d2-5cd8-45c5-9f79-73ef61de7a3f]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad48b2f-16e2-4b04-93c3-60bc0432df12_pca4p6zr {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:31 devstack sudo[140043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad48b2f-16e2-4b04-93c3-60bc0432df12_pca4p6zr Jun 20 00:10:31 devstack sudo[140043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:31 devstack sudo[140043]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ad48b2f-16e2-4b04-93c3-60bc0432df12_pca4p6zr" returned: 0 in 0.792s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad48b2f-16e2-4b04-93c3-60bc0432df12_pca4p6zr {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:31 devstack sudo[140069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad48b2f-16e2-4b04-93c3-60bc0432df12_pca4p6zr Jun 20 00:10:31 devstack sudo[140069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:32 devstack sudo[140069]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad48b2f-16e2-4b04-93c3-60bc0432df12_pca4p6zr" returned: 1 in 0.889s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ad48b2f-16e2-4b04-93c3-60bc0432df12_pca4p6zr' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:10:32 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3572b927-1b4f-45c6-8b02-2ba583f06b3d]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:32 devstack sudo[140100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD Jun 20 00:10:32 devstack sudo[140100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:33 devstack sudo[140100]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:33 devstack sudo[140128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD Jun 20 00:10:33 devstack sudo[140128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:34 devstack sudo[140128]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD" returned: 1 in 0.845s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:10:34 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] 5ad48b2f-16e2-4b04-93c3-60bc0432df12 was raw, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:10:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:34 devstack sudo[140160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 Jun 20 00:10:34 devstack sudo[140160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:34 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:10:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Flow 'volume_create_manager' (04d26339-9da4-42c5-9584-f16a0e8ec647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:10:34 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9133cc-c3c5-4e86-a2bc-7c973e086b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9133cc-c3c5-4e86-a2bc-7c973e086b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1044242646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a44f967-46e2-412f-90b1-145539cac258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1794ce0f91c7414bac07ea0f331f4e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:10:35Z,use_quota=True,user_id='a8ee286402064415bbb2967c3e1272d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea91427-3146-4fd4-a1bd-12b8877df2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ea91427-3146-4fd4-a1bd-12b8877df2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db038ffe-0130-42bd-bef3-600a204cec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db038ffe-0130-42bd-bef3-600a204cec79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a44f967-46e2-412f-90b1-145539cac258', 'volume_name': 'volume-8a44f967-46e2-412f-90b1-145539cac258', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef55edd-16ac-4e8c-b8a4-317a6632f8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef55edd-16ac-4e8c-b8a4-317a6632f8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3d78d7-cfa9-4f7f-af6c-914df9f462db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:35 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Volume 8a44f967-46e2-412f-90b1-145539cac258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a44f967-46e2-412f-90b1-145539cac258', 'volume_size': 1} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1044242646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a44f967-46e2-412f-90b1-145539cac258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1794ce0f91c7414bac07ea0f331f4e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:10:35Z,use_quota=True,user_id='a8ee286402064415bbb2967c3e1272d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Creating volume 8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:10:35 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:35 devstack sudo[140183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 1073741824 Jun 20 00:10:35 devstack sudo[140183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:35 devstack sudo[140160]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8" returned: 0 in 1.203s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ad48b2f-16e2-4b04-93c3-60bc0432df12__pysan8jdevstack@QuobyteHD, size 0.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:10:35 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Converted 0.00 MB image at 0.00 MB/s Jun 20 00:10:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:35 devstack sudo[140204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 1G Jun 20 00:10:35 devstack sudo[140204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:36 devstack sudo[140183]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 1073741824" returned: 0 in 1.232s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:36 devstack sudo[140237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 Jun 20 00:10:36 devstack sudo[140237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:36 devstack sudo[140204]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 1G" returned: 0 in 1.034s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:36 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfcd44a-2a17-4072-a4d7-d821a45ea0cf]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:36 devstack sudo[140247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 Jun 20 00:10:36 devstack sudo[140247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:37 devstack sudo[140237]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258" returned: 0 in 0.997s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3d78d7-cfa9-4f7f-af6c-914df9f462db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a44f967-46e2-412f-90b1-145539cac258', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e634a8dc-f396-4c02-954c-f13e6090f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Volume volume-8a44f967-46e2-412f-90b1-145539cac258 (8a44f967-46e2-412f-90b1-145539cac258): created successfully Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e634a8dc-f396-4c02-954c-f13e6090f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Flow 'volume_create_manager' (04d26339-9da4-42c5-9584-f16a0e8ec647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:10:37 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-74c7ee08-5930-4827-a5c2-9af1b5bcd936 tempest-TestStampPattern-1814979414 None] Created volume successfully. Jun 20 00:10:37 devstack sudo[140247]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8" returned: 0 in 1.171s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:37 devstack sudo[140289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 Jun 20 00:10:37 devstack sudo[140289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:38 devstack sudo[140289]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8" returned: 1 in 0.990s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Downloaded image 5ad48b2f-16e2-4b04-93c3-60bc0432df12 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'metadata': {}}])) to volume d51530ea-c981-4d1b-a851-3f0f76a1caf8 successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Temporary image 5ad48b2f-16e2-4b04-93c3-60bc0432df12 for user f50e48b888b8494485cd09bef706f0c4 is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Marking volume d51530ea-c981-4d1b-a851-3f0f76a1caf8 as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Copying metadata from image 5ad48b2f-16e2-4b04-93c3-60bc0432df12 to d51530ea-c981-4d1b-a851-3f0f76a1caf8. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Creating volume glance metadata for volume d51530ea-c981-4d1b-a851-3f0f76a1caf8 backed by image 5ad48b2f-16e2-4b04-93c3-60bc0432df12 with: {'image_id': '5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '37fd63d803dbf33be950c645262ff1e2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852bf9c9-fe16-48e4-874a-bb3c3583a11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8', 'volume_size': 1, 'image_id': '5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '37fd63d803dbf33be950c645262ff1e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c8045fa8bf514536afc785cf72bb6ca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ed2e9c068a07e4a97cb0805f45af641269cae8c0c2271926730c74b717b7e9b46fe284e55fec1dfc6dbbc93da3d0b50624264ac24d2ac0873d516a12910107f8', 'id': '5ad48b2f-16e2-4b04-93c3-60bc0432df12', 'created_at': datetime.datetime(2026, 6, 19, 22, 10, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ad48b2f-16e2-4b04-93c3-60bc0432df12/file', 'properties': {}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60bfbc0-04bc-4839-b492-b66c73d0e9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:38 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Volume volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 (d51530ea-c981-4d1b-a851-3f0f76a1caf8): created successfully Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60bfbc0-04bc-4839-b492-b66c73d0e9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Flow 'volume_create_manager' (5f666203-cc92-48af-8b12-66e090e4a4d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:10:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c626456f-5716-4a4d-b6b7-0cebfd38adde tempest-VolumeImageDependencyTests-982182974 None] Created volume successfully. Jun 20 00:10:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Acquiring lock "cinder-d51530ea-c981-4d1b-a851-3f0f76a1caf8-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Lock "cinder-d51530ea-c981-4d1b-a851-3f0f76a1caf8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Acquiring lock "cinder-quobyte-d51530ea-c981-4d1b-a851-3f0f76a1caf8" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:10:39 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Lock "cinder-quobyte-d51530ea-c981-4d1b-a851-3f0f76a1caf8" acquired by "delete_volume" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:10:39 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4375c8bc-29f6-4105-a264-a068dad953e4]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:40 devstack sudo[140357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 Jun 20 00:10:40 devstack sudo[140357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:40 devstack sudo[140357]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8" returned: 0 in 0.793s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:40 devstack sudo[140384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 Jun 20 00:10:40 devstack sudo[140384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:41 devstack sudo[140384]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8" returned: 1 in 0.799s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:10:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:41 devstack sudo[140411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8 Jun 20 00:10:41 devstack sudo[140411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:42 devstack sudo[140411]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d51530ea-c981-4d1b-a851-3f0f76a1caf8" returned: 0 in 0.657s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Lock "cinder-quobyte-d51530ea-c981-4d1b-a851-3f0f76a1caf8" released by "delete_volume" :: held 2.316s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Created reservations ['9e0e02d7-34a2-42e8-971f-46361555aa17', '48123516-e8f5-4e80-9de6-ba009853abbf', '837e1c2c-0a82-4873-a8fb-a086955ead23', 'e71012da-b8f6-4029-ac94-a0a0d6bb4df8'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:42 devstack sudo[140441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:10:42 devstack sudo[140441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:43 devstack sudo[140441]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.896s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:43 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:10:43 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Deleted volume successfully. Jun 20 00:10:43 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-2479e4b5-11c8-4bd4-b8e2-a6abfee078da tempest-VolumeImageDependencyTests-982182974 None] Lock "cinder-d51530ea-c981-4d1b-a851-3f0f76a1caf8-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:DELETE=10,cinder:UPDATE=102,cinder:SELECT=72,cinder:INSERT=28 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=96,cinder:SELECT=78,cinder:INSERT=26,cinder:DELETE=5 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Flow 'volume_create_manager' (684ede5e-a75a-4827-ad1f-605db8083de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27710eea-ab25-4770-88a9-c99c397c0f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27710eea-ab25-4770-88a9-c99c397c0f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-171241415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da705e9d7ff45c0a867d8fd77569769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:10:51Z,use_quota=True,user_id='2ce2ae3b460149fca61dbddd75798cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd319348-064c-4fb1-9067-ec7f3ff61fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd319348-064c-4fb1-9067-ec7f3ff61fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c7e296-f8e2-4e70-9b47-26bcb726f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84c7e296-f8e2-4e70-9b47-26bcb726f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1', 'volume_name': 'volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2788cacc-40d7-4917-ae55-5a7a4424d942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2788cacc-40d7-4917-ae55-5a7a4424d942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f65745-1583-4930-9bbc-83f8b8b1f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:50 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Volume 3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1', 'volume_size': 1} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-171241415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da705e9d7ff45c0a867d8fd77569769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:10:51Z,use_quota=True,user_id='2ce2ae3b460149fca61dbddd75798cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Creating volume 3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:10:50 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:10:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:50 devstack sudo[140721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 1073741824 Jun 20 00:10:50 devstack sudo[140721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:51 devstack sudo[140721]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 1073741824" returned: 0 in 1.234s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:52 devstack sudo[140833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 Jun 20 00:10:52 devstack sudo[140833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:52 devstack sudo[140833]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" returned: 0 in 0.732s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:10:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f65745-1583-4930-9bbc-83f8b8b1f143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3142c39-946b-4ee5-83f8-cb4fe516554a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:10:52 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Volume volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 (3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1): created successfully Jun 20 00:10:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3142c39-946b-4ee5-83f8-cb4fe516554a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:10:52 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Flow 'volume_create_manager' (684ede5e-a75a-4827-ad1f-605db8083de1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:10:52 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-89de7e02-8f2e-47d7-86c6-1f7ef6ef14d5 tempest-SnapshotDependencyTests-491854243 None] Created volume successfully. Jun 20 00:10:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:10:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:10:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Creating offline snapshot f45784de-6b8b-403a-97f9-f45f03a950ec of volume 3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:10:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf79a65-c596-4ec9-b023-cb997b47909c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:10:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:54 devstack sudo[140907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 Jun 20 00:10:54 devstack sudo[140907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:55 devstack sudo[140907]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" returned: 0 in 0.962s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:55 devstack sudo[140942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec 1G Jun 20 00:10:55 devstack sudo[140942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:56 devstack sudo[140942]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec 1G" returned: 0 in 0.861s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:56 devstack sudo[140973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec Jun 20 00:10:56 devstack sudo[140973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:56 devstack sudo[140973]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec" returned: 0 in 0.807s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:56 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec is being set with open permissions: ugo+rw Jun 20 00:10:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:56 devstack sudo[141004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec Jun 20 00:10:56 devstack sudo[141004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:57 devstack sudo[141004]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec" returned: 0 in 0.681s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:57 devstack sudo[141032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.info Jun 20 00:10:57 devstack sudo[141032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:58 devstack sudo[141032]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.info" returned: 0 in 0.726s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:58 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.info is being set with open permissions: ugo+rw Jun 20 00:10:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:10:58 devstack sudo[141056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.info Jun 20 00:10:58 devstack sudo[141056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:10:58 devstack sudo[141056]: pam_unix(sudo:session): session closed for user root Jun 20 00:10:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.info" returned: 0 in 0.643s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:10:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.815s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:10:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-68d2c308-5ce1-4353-b0cb-6b99e9fc996d tempest-SnapshotDependencyTests-491854243 None] Create snapshot completed successfully Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Flow 'volume_create_manager' (e8fc6fba-152a-4836-a24a-4b703170adc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88165612-ac98-4d10-bee2-c1e6bfff1705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88165612-ac98-4d10-bee2-c1e6bfff1705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd0a9ce-bec5-4daa-88f9-0c260f16806a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da705e9d7ff45c0a867d8fd77569769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f45784de-6b8b-403a-97f9-f45f03a950ec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:11:00Z,use_quota=True,user_id='2ce2ae3b460149fca61dbddd75798cf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a72c19e-1e77-45de-bc3a-c427b82b82b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a72c19e-1e77-45de-bc3a-c427b82b82b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af679041-a9e1-4a7d-9678-b4959cee15d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af679041-a9e1-4a7d-9678-b4959cee15d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8fd0a9ce-bec5-4daa-88f9-0c260f16806a', 'volume_name': 'volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a', 'volume_size': 1, 'snapshot_id': 'f45784de-6b8b-403a-97f9-f45f03a950ec'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9816f4-6e41-4db2-ba9d-0eb30ea02117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9816f4-6e41-4db2-ba9d-0eb30ea02117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51165321-0988-4f3c-b6c3-d243f3724c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:00 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Volume 8fd0a9ce-bec5-4daa-88f9-0c260f16806a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a', 'volume_size': 1, 'snapshot_id': 'f45784de-6b8b-403a-97f9-f45f03a950ec'} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-quobyte-f45784de-6b8b-403a-97f9-f45f03a950ec-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-f45784de-6b8b-403a-97f9-f45f03a950ec-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Creating volume 8fd0a9ce-bec5-4daa-88f9-0c260f16806a from snapshot f45784de-6b8b-403a-97f9-f45f03a950ec {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-quobyte-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] snapshot: f45784de-6b8b-403a-97f9-f45f03a950ec, volume: 8fd0a9ce-bec5-4daa-88f9-0c260f16806a, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d07bccc-b2de-46d9-b243-10e6da78769b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:00 devstack sudo[141121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec Jun 20 00:11:00 devstack sudo[141121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:00 devstack sudo[141121]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec" returned: 0 in 0.765s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[273fac59-f1ce-4bc2-9823-7d2b005dec4a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:01 devstack sudo[141148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 Jun 20 00:11:01 devstack sudo[141148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:01 devstack sudo[141148]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" returned: 0 in 0.766s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:01 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:11:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:01 devstack sudo[141177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a Jun 20 00:11:01 devstack sudo[141177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:07 devstack sudo[141177]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" returned: 0 in 5.352s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:07 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6f022e-5650-4bb7-b23b-2d736768046b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:07 devstack sudo[141375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 Jun 20 00:11:07 devstack sudo[141375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:08 devstack sudo[141375]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" returned: 0 in 0.910s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:11:08 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Converted 1024.00 MB image at 191.27 MB/s Jun 20 00:11:08 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a is being set with open permissions: ugo+rw Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:08 devstack sudo[141407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a Jun 20 00:11:08 devstack sudo[141407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:08 devstack sudo[141407]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" returned: 0 in 0.628s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" released by "_copy_volume_from_snapshot" :: held 8.507s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-f45784de-6b8b-403a-97f9-f45f03a950ec-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" released by "_create_volume_from_snapshot" :: held 8.533s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.549s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51165321-0988-4f3c-b6c3-d243f3724c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a', 'volume_size': 1, 'snapshot_id': 'f45784de-6b8b-403a-97f9-f45f03a950ec'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9b441a-3b37-49aa-a612-68b857cd866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:08 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Volume volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a (8fd0a9ce-bec5-4daa-88f9-0c260f16806a): created successfully Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9b441a-3b37-49aa-a612-68b857cd866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Flow 'volume_create_manager' (e8fc6fba-152a-4836-a24a-4b703170adc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:11:08 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b44712e5-504a-4718-a2b6-68cc03496787 tempest-SnapshotDependencyTests-491854243 None] Created volume successfully. Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-f45784de-6b8b-403a-97f9-f45f03a950ec-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-f45784de-6b8b-403a-97f9-f45f03a950ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-quobyte-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-quobyte-f45784de-6b8b-403a-97f9-f45f03a950ec" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-f45784de-6b8b-403a-97f9-f45f03a950ec" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Deleting offline snapshot f45784de-6b8b-403a-97f9-f45f03a950ec of volume 3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] snapshot_file for this snap is: volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee918d1-5ee2-492e-9ba6-cd8fa4eaaa46]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:09 devstack sudo[141441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec Jun 20 00:11:09 devstack sudo[141441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:09 devstack sudo[141441]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec" returned: 0 in 0.750s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cb49d2-48c5-489a-ae65-3b1ce59becbc]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:09 devstack sudo[141470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 Jun 20 00:11:09 devstack sudo[141470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:10 devstack sudo[141470]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" returned: 0 in 0.746s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:10 devstack sudo[141497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec Jun 20 00:11:10 devstack sudo[141497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:11 devstack sudo[141497]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec" returned: 0 in 0.733s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:11 devstack sudo[141525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec Jun 20 00:11:11 devstack sudo[141525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:11 devstack sudo[141525]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1.f45784de-6b8b-403a-97f9-f45f03a950ec" returned: 0 in 0.647s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-f45784de-6b8b-403a-97f9-f45f03a950ec" released by "_delete_snapshot" :: held 2.979s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" released by "delete_snapshot" :: held 2.999s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Created reservations ['97aac91e-f3f2-4883-a5e7-d8c582ae6460', 'fc690bc2-9480-4369-bfc2-ac85c52b9dc2', '300e1744-1276-4583-bc99-1b660f7995eb', '34b8e44f-45f6-43b3-833d-7303a9e4ed86'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:11:12 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Delete snapshot completed successfully. Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8e637423-eeab-40bb-9101-64583664d162 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-f45784de-6b8b-403a-97f9-f45f03a950ec-delete_snapshot" released by "delete_snapshot" :: held 3.153s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-quobyte-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94906ff-208c-4344-aac5-322f5c77408a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:12 devstack sudo[141560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 Jun 20 00:11:12 devstack sudo[141560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:13 devstack sudo[141560]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" returned: 0 in 0.758s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:13 devstack sudo[141586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1 Jun 20 00:11:13 devstack sudo[141586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:13 devstack sudo[141586]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" returned: 0 in 0.645s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1" released by "delete_volume" :: held 1.463s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Created reservations ['a35ef010-581c-4adf-8e65-dcba9afa4426', '490cf141-69d8-4c9e-8fce-1b39b9408f21', 'f5ff58a1-e626-40be-b994-170715321530', '706b9036-1425-4e59-ab64-1b79ba8c95d7'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:13 devstack sudo[141613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:11:13 devstack sudo[141613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-8fd0a9ce-bec5-4daa-88f9-0c260f16806a-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-8fd0a9ce-bec5-4daa-88f9-0c260f16806a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "cinder-quobyte-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:14 devstack sudo[141613]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.654s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:11:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Deleted volume successfully. Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c86e7f0-9411-4be2-be85-bacbaed33133]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9078c9a0-4ffc-4254-bf5a-709a6c817149 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-3b8c0c60-59cf-47bd-a593-b1ffd8f93bc1-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:14 devstack sudo[141637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a Jun 20 00:11:14 devstack sudo[141637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:15 devstack sudo[141637]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" returned: 0 in 0.732s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:15 devstack sudo[141663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a Jun 20 00:11:15 devstack sudo[141663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:15 devstack sudo[141663]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" returned: 0 in 0.656s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-quobyte-8fd0a9ce-bec5-4daa-88f9-0c260f16806a" released by "delete_volume" :: held 1.434s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:15 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Created reservations ['77c78a30-ecb1-4084-b4c7-5abea44f46e6', '0e244868-fee7-4969-b8b9-3832d444e0ab', '847a50f1-8207-49ae-88c9-f8cf16788c4a', 'c2d583e0-4653-43ce-9650-ddc8cfb4aac0'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:16 devstack sudo[141691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:11:16 devstack sudo[141691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:16 devstack sudo[141691]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.663s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:11:16 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Deleted volume successfully. Jun 20 00:11:16 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ccd54c3c-14b9-4663-8a40-0d7b0a87cc87 tempest-SnapshotDependencyTests-491854243 None] Lock "cinder-8fd0a9ce-bec5-4daa-88f9-0c260f16806a-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-09245ead-b50d-411d-a808-253de6aeed8e req-93462d6d-3bec-42a8-b2ed-c2bc58ce88fe tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-09245ead-b50d-411d-a808-253de6aeed8e req-93462d6d-3bec-42a8-b2ed-c2bc58ce88fe tempest-TestStampPattern-1814979414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:20 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd19099-a3bf-4671-83b2-a56d33b482ec]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-09245ead-b50d-411d-a808-253de6aeed8e req-93462d6d-3bec-42a8-b2ed-c2bc58ce88fe tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:20 devstack sudo[141842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 Jun 20 00:11:20 devstack sudo[141842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:21 devstack sudo[141842]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-09245ead-b50d-411d-a808-253de6aeed8e req-93462d6d-3bec-42a8-b2ed-c2bc58ce88fe tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258" returned: 0 in 0.898s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-09245ead-b50d-411d-a808-253de6aeed8e req-93462d6d-3bec-42a8-b2ed-c2bc58ce88fe tempest-TestStampPattern-1814979414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.922s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:21 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-09245ead-b50d-411d-a808-253de6aeed8e req-93462d6d-3bec-42a8-b2ed-c2bc58ce88fe tempest-TestStampPattern-1814979414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-8a44f967-46e2-412f-90b1-145539cac258', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af907c36-868d-4bb6-95d6-5c3c3f282c04', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:11:21 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-09245ead-b50d-411d-a808-253de6aeed8e req-93462d6d-3bec-42a8-b2ed-c2bc58ce88fe tempest-TestStampPattern-1814979414 None] attachment_update completed successfully. Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:28 devstack sudo[142522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:11:28 devstack sudo[142522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:28 devstack sudo[142522]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.658s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:11:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:11:30 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-155b5a2e-34fc-4c16-91d0-8e7f6fc37ab8 req-c2e9f491-7258-4230-b372-e22cf007f427 tempest-TestStampPattern-1814979414 None] Terminate volume connection completed successfully. Jun 20 00:11:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-155b5a2e-34fc-4c16-91d0-8e7f6fc37ab8 req-c2e9f491-7258-4230-b372-e22cf007f427 tempest-TestStampPattern-1814979414 None] Deleting attachment af907c36-868d-4bb6-95d6-5c3c3f282c04. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:11:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:32 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Creating offline snapshot 231280a8-4d90-48c6-91d5-a5814cff2a61 of volume 8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:11:32 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd87ff8b-d470-44ef-829c-65ae6f7af6c8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:32 devstack sudo[142689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 Jun 20 00:11:32 devstack sudo[142689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:32 devstack sudo[142689]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258" returned: 0 in 0.746s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:33 devstack sudo[142716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 1G Jun 20 00:11:33 devstack sudo[142716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:33 devstack sudo[142716]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 1G" returned: 0 in 0.785s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a44f967-46e2-412f-90b1-145539cac258 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:33 devstack sudo[142745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a44f967-46e2-412f-90b1-145539cac258 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 Jun 20 00:11:33 devstack sudo[142745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:34 devstack sudo[142745]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a44f967-46e2-412f-90b1-145539cac258 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61" returned: 0 in 0.669s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:34 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 is being set with open permissions: ugo+rw Jun 20 00:11:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:34 devstack sudo[142768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 Jun 20 00:11:34 devstack sudo[142768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:35 devstack sudo[142768]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61" returned: 0 in 0.641s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:35 devstack sudo[142792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.info Jun 20 00:11:35 devstack sudo[142792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:35 devstack sudo[142792]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.info" returned: 0 in 0.667s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:35 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.info is being set with open permissions: ugo+rw Jun 20 00:11:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:35 devstack sudo[142817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.info Jun 20 00:11:35 devstack sudo[142817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:36 devstack sudo[142817]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.info" returned: 0 in 0.639s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.229s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:36 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e701d097-52d5-4ba4-8b34-24c0cdb01943 tempest-TestStampPattern-1814979414 None] Create snapshot completed successfully Jun 20 00:11:46 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=30,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=3 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:11:46 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=37,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Flow 'volume_create_manager' (8c1f5a90-82a7-49bf-b06f-97dde4a1d82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f51f00-5a2f-4d10-b40f-1263c9c6950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f51f00-5a2f-4d10-b40f-1263c9c6950b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1360351640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a952fa2-5753-4755-8587-a907085f68fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1794ce0f91c7414bac07ea0f331f4e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=231280a8-4d90-48c6-91d5-a5814cff2a61,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:11:47Z,use_quota=True,user_id='a8ee286402064415bbb2967c3e1272d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad414e11-9301-440f-b195-4ca9069a66fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad414e11-9301-440f-b195-4ca9069a66fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03db2c4b-6b03-47f5-acd2-1253c225cfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03db2c4b-6b03-47f5-acd2-1253c225cfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a952fa2-5753-4755-8587-a907085f68fd', 'volume_name': 'volume-3a952fa2-5753-4755-8587-a907085f68fd', 'volume_size': 1, 'snapshot_id': '231280a8-4d90-48c6-91d5-a5814cff2a61'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53ff530-f946-4d90-81cd-5573341ccbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53ff530-f946-4d90-81cd-5573341ccbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de57c5a-cc6b-4387-9b1e-fc01dcc5bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:47 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Volume 3a952fa2-5753-4755-8587-a907085f68fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a952fa2-5753-4755-8587-a907085f68fd', 'volume_size': 1, 'snapshot_id': '231280a8-4d90-48c6-91d5-a5814cff2a61'} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-quobyte-231280a8-4d90-48c6-91d5-a5814cff2a61-3a952fa2-5753-4755-8587-a907085f68fd" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-231280a8-4d90-48c6-91d5-a5814cff2a61-3a952fa2-5753-4755-8587-a907085f68fd" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Creating volume 3a952fa2-5753-4755-8587-a907085f68fd from snapshot 231280a8-4d90-48c6-91d5-a5814cff2a61 {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-quobyte-3a952fa2-5753-4755-8587-a907085f68fd" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-3a952fa2-5753-4755-8587-a907085f68fd" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] snapshot: 231280a8-4d90-48c6-91d5-a5814cff2a61, volume: 3a952fa2-5753-4755-8587-a907085f68fd, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddc9668-553c-4f0b-be7a-c23f2544bd49]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:47 devstack sudo[143199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 Jun 20 00:11:47 devstack sudo[143199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:48 devstack sudo[143199]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61" returned: 0 in 0.804s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a44f967-46e2-412f-90b1-145539cac258(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cb5e4c-1b89-4e8a-98a7-4da5614e00cf]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:48 devstack sudo[143230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 Jun 20 00:11:48 devstack sudo[143230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:48 devstack sudo[143230]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258" returned: 0 in 0.812s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:11:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:48 devstack sudo[143264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd Jun 20 00:11:48 devstack sudo[143264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:54 devstack sudo[143264]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd" returned: 0 in 5.174s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a81c74-a314-45cb-ad8d-eeca964c63d7]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:11:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:54 devstack sudo[143429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 Jun 20 00:11:54 devstack sudo[143429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:55 devstack sudo[143429]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258" returned: 0 in 1.018s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:55 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:11:55 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Converted 1024.00 MB image at 197.88 MB/s Jun 20 00:11:55 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd is being set with open permissions: ugo+rw Jun 20 00:11:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:11:55 devstack sudo[143464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd Jun 20 00:11:55 devstack sudo[143464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:11:55 devstack sudo[143464]: pam_unix(sudo:session): session closed for user root Jun 20 00:11:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd" returned: 0 in 0.815s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:11:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-3a952fa2-5753-4755-8587-a907085f68fd" released by "_copy_volume_from_snapshot" :: held 8.730s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-231280a8-4d90-48c6-91d5-a5814cff2a61-3a952fa2-5753-4755-8587-a907085f68fd" released by "_create_volume_from_snapshot" :: held 8.767s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:11:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.790s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:11:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de57c5a-cc6b-4387-9b1e-fc01dcc5bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a952fa2-5753-4755-8587-a907085f68fd', 'volume_size': 1, 'snapshot_id': '231280a8-4d90-48c6-91d5-a5814cff2a61'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eec767a-d661-4eee-8ac5-54f131770dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:11:56 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Volume volume-3a952fa2-5753-4755-8587-a907085f68fd (3a952fa2-5753-4755-8587-a907085f68fd): created successfully Jun 20 00:11:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eec767a-d661-4eee-8ac5-54f131770dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:11:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Flow 'volume_create_manager' (8c1f5a90-82a7-49bf-b06f-97dde4a1d82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:11:56 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a5803c92-39c8-4bce-b9a3-040fc4916529 tempest-TestStampPattern-1814979414 None] Created volume successfully. Jun 20 00:12:06 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:12:06 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:28 devstack sudo[144609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:12:28 devstack sudo[144609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:28 devstack sudo[144609]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.630s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:12:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:12:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc234acb-5f9e-4c0e-b95d-22946f1b1328 req-51120988-af99-4d9d-8914-e590cae48f9a tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:12:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc234acb-5f9e-4c0e-b95d-22946f1b1328 req-51120988-af99-4d9d-8914-e590cae48f9a tempest-TestStampPattern-1814979414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:12:31 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a797774-2b72-4ca9-aacf-8e08b17e9391]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:12:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-bc234acb-5f9e-4c0e-b95d-22946f1b1328 req-51120988-af99-4d9d-8914-e590cae48f9a tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:31 devstack sudo[144741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd Jun 20 00:12:31 devstack sudo[144741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:32 devstack sudo[144741]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [req-bc234acb-5f9e-4c0e-b95d-22946f1b1328 req-51120988-af99-4d9d-8914-e590cae48f9a tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd" returned: 0 in 0.745s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [req-bc234acb-5f9e-4c0e-b95d-22946f1b1328 req-51120988-af99-4d9d-8914-e590cae48f9a tempest-TestStampPattern-1814979414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.763s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:12:32 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-bc234acb-5f9e-4c0e-b95d-22946f1b1328 req-51120988-af99-4d9d-8914-e590cae48f9a tempest-TestStampPattern-1814979414 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22', 'name': 'volume-3a952fa2-5753-4755-8587-a907085f68fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3867b07-feef-4b62-9db6-d7f116e3c36a', 'enforce_multipath': True} {{(pid=93391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 20 00:12:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-bc234acb-5f9e-4c0e-b95d-22946f1b1328 req-51120988-af99-4d9d-8914-e590cae48f9a tempest-TestStampPattern-1814979414 None] attachment_update completed successfully. Jun 20 00:12:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [req-16eadde4-447b-43a2-8866-4427fa7d99f1 req-9dc28aaf-eff9-4729-b165-c43aa0180c9e tempest-TestStampPattern-1814979414 None] Terminate volume connection completed successfully. Jun 20 00:12:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [req-16eadde4-447b-43a2-8866-4427fa7d99f1 req-9dc28aaf-eff9-4729-b165-c43aa0180c9e tempest-TestStampPattern-1814979414 None] Deleting attachment e3867b07-feef-4b62-9db6-d7f116e3c36a. {{(pid=93391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 20 00:12:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-3a952fa2-5753-4755-8587-a907085f68fd-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:12:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Lock "cinder-3a952fa2-5753-4755-8587-a907085f68fd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:12:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-quobyte-3a952fa2-5753-4755-8587-a907085f68fd" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:12:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-3a952fa2-5753-4755-8587-a907085f68fd" acquired by "delete_volume" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:12:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58961d2a-7465-442f-b906-989f538987c9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:12:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:49 devstack sudo[145737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd Jun 20 00:12:49 devstack sudo[145737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:49 devstack sudo[145737]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd" returned: 0 in 0.751s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:50 devstack sudo[145767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd Jun 20 00:12:50 devstack sudo[145767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:50 devstack sudo[145767]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3a952fa2-5753-4755-8587-a907085f68fd" returned: 0 in 0.631s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-3a952fa2-5753-4755-8587-a907085f68fd" released by "delete_volume" :: held 1.420s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Created reservations ['0511a256-b639-4ba3-8270-46fb72e6da1f', '997d7785-c9ff-49b9-8dfc-b576656656e4', '50f3185a-522f-4b61-9504-8c52a81ebff7', '2f0bc390-8d84-4f46-b590-226cde981e5f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:12:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:50 devstack sudo[145791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:12:50 devstack sudo[145791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:51 devstack sudo[145791]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.645s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:12:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Deleted volume successfully. Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fb96e59b-49b0-44ef-9d20-7ec2511203ef tempest-TestStampPattern-1814979414 None] Lock "cinder-3a952fa2-5753-4755-8587-a907085f68fd-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-231280a8-4d90-48c6-91d5-a5814cff2a61-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Lock "cinder-231280a8-4d90-48c6-91d5-a5814cff2a61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-quobyte-8a44f967-46e2-412f-90b1-145539cac258" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-8a44f967-46e2-412f-90b1-145539cac258" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-quobyte-231280a8-4d90-48c6-91d5-a5814cff2a61" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-231280a8-4d90-48c6-91d5-a5814cff2a61" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Deleting offline snapshot 231280a8-4d90-48c6-91d5-a5814cff2a61 of volume 8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] snapshot_file for this snap is: volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e7598f-0d2e-43d6-bfbe-a754e7f9845e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:12:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:51 devstack sudo[145824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 Jun 20 00:12:51 devstack sudo[145824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:52 devstack sudo[145824]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61" returned: 0 in 0.739s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a44f967-46e2-412f-90b1-145539cac258(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:12:52 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d803859-47a0-405a-ab99-20ae2eb280f9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:12:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:52 devstack sudo[145850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 Jun 20 00:12:52 devstack sudo[145850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:53 devstack sudo[145850]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258" returned: 0 in 0.751s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:53 devstack sudo[145879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 Jun 20 00:12:53 devstack sudo[145879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:53 devstack sudo[145879]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61" returned: 0 in 0.710s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:12:53 devstack sudo[145906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61 Jun 20 00:12:53 devstack sudo[145906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:12:54 devstack sudo[145906]: pam_unix(sudo:session): session closed for user root Jun 20 00:12:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258.231280a8-4d90-48c6-91d5-a5814cff2a61" returned: 0 in 0.629s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:12:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-231280a8-4d90-48c6-91d5-a5814cff2a61" released by "_delete_snapshot" :: held 2.923s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:12:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-8a44f967-46e2-412f-90b1-145539cac258" released by "delete_snapshot" :: held 2.947s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:12:54 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Created reservations ['5dfef410-a7a7-4b86-a034-7cf349eb393e', '0962d72a-963c-47b0-b097-d8ad3aef39e2', '27406c93-36bf-4899-85b7-2bbf3c985de2', '8eef885d-f86a-4754-a357-996c4657c2ae'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:12:54 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Delete snapshot completed successfully. Jun 20 00:12:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b66df067-707b-43ac-b9f8-160c1908798b tempest-TestStampPattern-1814979414 None] Lock "cinder-231280a8-4d90-48c6-91d5-a5814cff2a61-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-8a44f967-46e2-412f-90b1-145539cac258-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Lock "cinder-8a44f967-46e2-412f-90b1-145539cac258-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Acquiring lock "cinder-quobyte-8a44f967-46e2-412f-90b1-145539cac258" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-8a44f967-46e2-412f-90b1-145539cac258" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:02 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09561d72-c984-44d6-8878-4ab8c32073aa]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:02 devstack sudo[146202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 Jun 20 00:13:02 devstack sudo[146202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:02 devstack sudo[146202]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258" returned: 0 in 0.750s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:02 devstack sudo[146229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258 Jun 20 00:13:02 devstack sudo[146229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:03 devstack sudo[146229]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8a44f967-46e2-412f-90b1-145539cac258" returned: 0 in 0.633s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Lock "cinder-quobyte-8a44f967-46e2-412f-90b1-145539cac258" released by "delete_volume" :: held 1.439s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Created reservations ['a5e3977e-31cb-4a39-ad9c-6f9fb1d9dcdf', 'b7179573-fe20-49a3-b5e4-a06a024a6c2a', 'def4b50f-9117-4c64-83f5-7fd6fb845d9f', '98d4c462-64fd-44f8-ba85-8aac2adca09a'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:03 devstack sudo[146255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:13:03 devstack sudo[146255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:04 devstack sudo[146255]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.643s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:04 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:13:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Deleted volume successfully. Jun 20 00:13:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4b0a015-b7b2-4a27-8d5e-c586bfb8ab26 tempest-TestStampPattern-1814979414 None] Lock "cinder-8a44f967-46e2-412f-90b1-145539cac258-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:13 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=6 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:13:15 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Flow 'volume_create_manager' (40ab56da-ec46-40a9-aff0-9089a0f95f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fd0fec-8d6b-4cc0-973a-e57c64b5080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fd0fec-8d6b-4cc0-973a-e57c64b5080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f02eac-a3a8-4c34-9155-63970cb4c599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b40467dd4a241b9a0b9b5f44c8365cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:18Z,use_quota=True,user_id='ba432c3236e54163af735d3220064913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e601260f-b474-49ee-ab38-7b6cacb153bf),volume_type_id=e601260f-b474-49ee-ab38-7b6cacb153bf)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4dbc7a5-f91e-4de3-91d0-ff55ccc3db1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4dbc7a5-f91e-4de3-91d0-ff55ccc3db1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae41ebc-5755-42d1-aa8e-9e829c256fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae41ebc-5755-42d1-aa8e-9e829c256fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92f02eac-a3a8-4c34-9155-63970cb4c599', 'volume_name': 'volume-92f02eac-a3a8-4c34-9155-63970cb4c599', 'volume_size': 1, 'image_id': 'd876fd81-1a00-4a57-a88c-bced918b606d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d876fd81-1a00-4a57-a88c-bced918b606d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9967a85048f2370a26415c4e93bff77a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b40467dd4a241b9a0b9b5f44c8365cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab4eb91e007315c99b9e3ee49e9e406306b1bd3305d11aba72b0ef1fc48ea96aed3e6495f309e6e9efbc5a8a32f658037bbd0633bfa0e56828545e5d75e3c101', 'id': 'd876fd81-1a00-4a57-a88c-bced918b606d', 'created_at': datetime.datetime(2026, 6, 19, 22, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d876fd81-1a00-4a57-a88c-bced918b606d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73e5f08-a11a-4fca-a87d-472082446bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73e5f08-a11a-4fca-a87d-472082446bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ad0b7e-3f67-4cd9-93f6-6422b104ebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:17 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Volume 92f02eac-a3a8-4c34-9155-63970cb4c599: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92f02eac-a3a8-4c34-9155-63970cb4c599', 'volume_size': 1, 'image_id': 'd876fd81-1a00-4a57-a88c-bced918b606d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d876fd81-1a00-4a57-a88c-bced918b606d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9967a85048f2370a26415c4e93bff77a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b40467dd4a241b9a0b9b5f44c8365cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab4eb91e007315c99b9e3ee49e9e406306b1bd3305d11aba72b0ef1fc48ea96aed3e6495f309e6e9efbc5a8a32f658037bbd0633bfa0e56828545e5d75e3c101', 'id': 'd876fd81-1a00-4a57-a88c-bced918b606d', 'created_at': datetime.datetime(2026, 6, 19, 22, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d876fd81-1a00-4a57-a88c-bced918b606d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 20 00:13:17 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Trying to clone 92f02eac-a3a8-4c34-9155-63970cb4c599 from image d876fd81-1a00-4a57-a88c-bced918b606d at location (None, [{'url': 'file:///opt/stack/data/glance/images/d876fd81-1a00-4a57-a88c-bced918b606d', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:13:18 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:13:18 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Image download 0.00 MB at 0.00 MB/s Jun 20 00:13:18 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[630a78bd-3780-4f8f-be3b-7370975fd985]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:18 devstack sudo[146697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD Jun 20 00:13:18 devstack sudo[146697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:18 devstack sudo[146697]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD" returned: 0 in 0.708s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:18 devstack sudo[146724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD Jun 20 00:13:18 devstack sudo[146724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:19 devstack sudo[146724]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD" returned: 1 in 0.712s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:13:19 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Temporary image d876fd81-1a00-4a57-a88c-bced918b606d is fetched for user ba432c3236e54163af735d3220064913. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:13:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e57668-497c-455a-8055-29f9db90ae8c]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:19 devstack sudo[146753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD Jun 20 00:13:19 devstack sudo[146753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:20 devstack sudo[146753]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD" returned: 0 in 0.711s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:20 devstack sudo[146778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD Jun 20 00:13:20 devstack sudo[146778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:20 devstack sudo[146778]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD" returned: 1 in 0.705s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f02eac-a3a8-4c34-9155-63970cb4c599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b40467dd4a241b9a0b9b5f44c8365cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:18Z,use_quota=True,user_id='ba432c3236e54163af735d3220064913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e601260f-b474-49ee-ab38-7b6cacb153bf),volume_type_id=e601260f-b474-49ee-ab38-7b6cacb153bf)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Creating volume 92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:13:20 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:13:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:20 devstack sudo[146804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 1073741824 Jun 20 00:13:20 devstack sudo[146804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:21 devstack sudo[146804]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 1073741824" returned: 0 in 0.842s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:21 devstack sudo[146872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 Jun 20 00:13:21 devstack sudo[146872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:22 devstack sudo[146872]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599" returned: 0 in 0.628s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:22 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:13:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:22 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Attempting download of d876fd81-1a00-4a57-a88c-bced918b606d ((None, [{'url': 'file:///opt/stack/data/glance/images/d876fd81-1a00-4a57-a88c-bced918b606d', 'metadata': {}}])) to volume 92f02eac-a3a8-4c34-9155-63970cb4c599. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:13:22 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[382baacb-fb1c-4c31-abb5-ac14a3e01a46]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d876fd81-1a00-4a57-a88c-bced918b606d_n9gufdu8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:22 devstack sudo[146894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d876fd81-1a00-4a57-a88c-bced918b606d_n9gufdu8 Jun 20 00:13:22 devstack sudo[146894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:23 devstack sudo[146894]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d876fd81-1a00-4a57-a88c-bced918b606d_n9gufdu8" returned: 0 in 0.735s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d876fd81-1a00-4a57-a88c-bced918b606d_n9gufdu8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:23 devstack sudo[146922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d876fd81-1a00-4a57-a88c-bced918b606d_n9gufdu8 Jun 20 00:13:23 devstack sudo[146922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:24 devstack sudo[146922]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d876fd81-1a00-4a57-a88c-bced918b606d_n9gufdu8" returned: 1 in 0.726s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d876fd81-1a00-4a57-a88c-bced918b606d_n9gufdu8' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:13:24 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4ff75a-fcd7-40e7-868d-99971825672d]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:24 devstack sudo[146947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD Jun 20 00:13:24 devstack sudo[146947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:24 devstack sudo[146947]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD" returned: 0 in 0.705s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:24 devstack sudo[146972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD Jun 20 00:13:24 devstack sudo[146972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:25 devstack sudo[146972]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD" returned: 1 in 0.708s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:13:25 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] d876fd81-1a00-4a57-a88c-bced918b606d was raw, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:13:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:25 devstack sudo[146998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 Jun 20 00:13:25 devstack sudo[146998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:26 devstack sudo[146998]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599" returned: 0 in 0.732s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:26 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d876fd81-1a00-4a57-a88c-bced918b606d_776gr049devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:13:26 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Converted 0.00 MB image at 0.00 MB/s Jun 20 00:13:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:26 devstack sudo[147027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 1G Jun 20 00:13:26 devstack sudo[147027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:26 devstack sudo[147027]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 1G" returned: 0 in 0.658s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:26 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41018833-0c10-472c-b3f4-cb5f8b1eac75]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:26 devstack sudo[147052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 Jun 20 00:13:26 devstack sudo[147052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:27 devstack sudo[147052]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599" returned: 0 in 0.751s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:27 devstack sudo[147080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 Jun 20 00:13:27 devstack sudo[147080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:28 devstack sudo[147094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:13:28 devstack sudo[147094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:28 devstack sudo[147080]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599" returned: 1 in 0.757s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Downloaded image d876fd81-1a00-4a57-a88c-bced918b606d ((None, [{'url': 'file:///opt/stack/data/glance/images/d876fd81-1a00-4a57-a88c-bced918b606d', 'metadata': {}}])) to volume 92f02eac-a3a8-4c34-9155-63970cb4c599 successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Temporary image d876fd81-1a00-4a57-a88c-bced918b606d for user ba432c3236e54163af735d3220064913 is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Marking volume 92f02eac-a3a8-4c34-9155-63970cb4c599 as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Copying metadata from image d876fd81-1a00-4a57-a88c-bced918b606d to 92f02eac-a3a8-4c34-9155-63970cb4c599. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Creating volume glance metadata for volume 92f02eac-a3a8-4c34-9155-63970cb4c599 backed by image d876fd81-1a00-4a57-a88c-bced918b606d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd876fd81-1a00-4a57-a88c-bced918b606d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9967a85048f2370a26415c4e93bff77a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ad0b7e-3f67-4cd9-93f6-6422b104ebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f02eac-a3a8-4c34-9155-63970cb4c599', 'volume_size': 1, 'image_id': 'd876fd81-1a00-4a57-a88c-bced918b606d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d876fd81-1a00-4a57-a88c-bced918b606d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9967a85048f2370a26415c4e93bff77a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b40467dd4a241b9a0b9b5f44c8365cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab4eb91e007315c99b9e3ee49e9e406306b1bd3305d11aba72b0ef1fc48ea96aed3e6495f309e6e9efbc5a8a32f658037bbd0633bfa0e56828545e5d75e3c101', 'id': 'd876fd81-1a00-4a57-a88c-bced918b606d', 'created_at': datetime.datetime(2026, 6, 19, 22, 13, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d876fd81-1a00-4a57-a88c-bced918b606d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3de969-833f-43a3-9ed6-8479211f43fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:28 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Volume volume-92f02eac-a3a8-4c34-9155-63970cb4c599 (92f02eac-a3a8-4c34-9155-63970cb4c599): created successfully Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3de969-833f-43a3-9ed6-8479211f43fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Flow 'volume_create_manager' (40ab56da-ec46-40a9-aff0-9089a0f95f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:28 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a1a1d68c-8dcb-412f-b056-e20d47609367 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Created volume successfully. Jun 20 00:13:28 devstack sudo[147094]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.649s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:13:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:13:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Acquiring lock "cinder-92f02eac-a3a8-4c34-9155-63970cb4c599-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "cinder-92f02eac-a3a8-4c34-9155-63970cb4c599-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Acquiring lock "cinder-quobyte-92f02eac-a3a8-4c34-9155-63970cb4c599" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "cinder-quobyte-92f02eac-a3a8-4c34-9155-63970cb4c599" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:29 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7863d59-d89b-4c1b-b9e6-5e0825efb6e6]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:29 devstack sudo[147139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 Jun 20 00:13:29 devstack sudo[147139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:30 devstack sudo[147139]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599" returned: 0 in 0.742s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:30 devstack sudo[147164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 Jun 20 00:13:30 devstack sudo[147164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:30 devstack sudo[147164]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599" returned: 1 in 0.740s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:13:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:30 devstack sudo[147193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599 Jun 20 00:13:30 devstack sudo[147193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:31 devstack sudo[147193]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-92f02eac-a3a8-4c34-9155-63970cb4c599" returned: 0 in 0.637s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "cinder-quobyte-92f02eac-a3a8-4c34-9155-63970cb4c599" released by "delete_volume" :: held 2.179s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:31 devstack cinder-volume[93391]: WARNING cinder.quota [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:13:31 devstack cinder-volume[93391]: WARNING cinder.quota [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Created reservations ['2bbccac8-618d-471e-8bda-b4d13771bf0a', 'a8e4c0c5-c938-4cab-acff-2bb8544c9903', '694310a4-8f1d-4ee4-bb64-8abbae563f14', 'c0c92a28-cc1f-4e13-b2fc-a7d9feda4f00'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:31 devstack sudo[147217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:13:31 devstack sudo[147217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:32 devstack sudo[147217]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.622s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:32 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:13:32 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Deleted volume successfully. Jun 20 00:13:32 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-a007d6fc-cc60-4b28-a7b8-0756c7558eb9 tempest-VolumeAndVolumeTypeFromImageTest-914496143 None] Lock "cinder-92f02eac-a3a8-4c34-9155-63970cb4c599-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (6ba06595-b69c-47a6-9032-60a5248f6e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc157c1b-dca2-442c-8d60-24857d5a1deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc157c1b-dca2-442c-8d60-24857d5a1deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230259701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ddc9b4-79a3-4728-8b96-e1341ff30c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:36Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acdcd1f-774f-428b-9528-045d94620db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7acdcd1f-774f-428b-9528-045d94620db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1cd82b-c1a4-4b21-8013-5226adc54719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1cd82b-c1a4-4b21-8013-5226adc54719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ddc9b4-79a3-4728-8b96-e1341ff30c12', 'volume_name': 'volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bc19aa-f3ae-48fc-b68c-5e899780c5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bc19aa-f3ae-48fc-b68c-5e899780c5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f3bfdc-b511-48e3-915c-e3dafadfe35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Volume c3ddc9b4-79a3-4728-8b96-e1341ff30c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12', 'volume_size': 1} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230259701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ddc9b4-79a3-4728-8b96-e1341ff30c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:36Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Creating volume c3ddc9b4-79a3-4728-8b96-e1341ff30c12 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:13:36 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:36 devstack sudo[147371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 1073741824 Jun 20 00:13:36 devstack sudo[147371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (d5a76c3e-6258-49d7-bd80-2beb2d057ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd221e2a-4e4e-4326-9c71-836ff388b63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd221e2a-4e4e-4326-9c71-836ff388b63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-485408144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec0c833-b52b-4b3d-ba80-41c2edb79173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:37Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7fc7c0-0612-4717-90e6-8c75c3d1d3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf7fc7c0-0612-4717-90e6-8c75c3d1d3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5aaaf6-874b-4ca1-8035-c71a1de59e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5aaaf6-874b-4ca1-8035-c71a1de59e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec0c833-b52b-4b3d-ba80-41c2edb79173', 'volume_name': 'volume-bec0c833-b52b-4b3d-ba80-41c2edb79173', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97114ff-7ab4-41a9-b6f3-518442a39250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97114ff-7ab4-41a9-b6f3-518442a39250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49279b18-fa46-4b9f-a089-1c4c57660863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Volume bec0c833-b52b-4b3d-ba80-41c2edb79173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec0c833-b52b-4b3d-ba80-41c2edb79173', 'volume_size': 1} Jun 20 00:13:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (eb73b68f-a249-4b7b-8fdf-f7a707fcd159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc23b2d-dbcc-4805-88fc-08cf35b10a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc23b2d-dbcc-4805-88fc-08cf35b10a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2240994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da8c04b-c3f4-4a57-b44e-b825b9c78a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:37Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df54dcac-3e5c-4e07-b9fa-e67f04ae7dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df54dcac-3e5c-4e07-b9fa-e67f04ae7dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a0583c-efb4-4e83-9ab3-68b9dea955fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a0583c-efb4-4e83-9ab3-68b9dea955fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da8c04b-c3f4-4a57-b44e-b825b9c78a0b', 'volume_name': 'volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43896258-c5c7-4421-b7e9-3602ebeb27a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43896258-c5c7-4421-b7e9-3602ebeb27a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162ba468-b11a-4a08-be6d-6434282c7fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Volume 6da8c04b-c3f4-4a57-b44e-b825b9c78a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b', 'volume_size': 1} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:37 devstack sudo[147371]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 1073741824" returned: 0 in 0.922s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:13:37 devstack sudo[147407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 Jun 20 00:13:37 devstack sudo[147407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (fc70951a-b701-4691-b00e-20e46d902e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa2cf70-35a9-41b0-a109-d573ed325d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa2cf70-35a9-41b0-a109-d573ed325d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1562230599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90120d4-6779-48c4-84cc-09ced092b0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:38Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a85c0c6-a809-4d84-b363-72001857e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a85c0c6-a809-4d84-b363-72001857e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d2b6ed-227a-470c-860b-3a5065dbec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d2b6ed-227a-470c-860b-3a5065dbec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90120d4-6779-48c4-84cc-09ced092b0ca', 'volume_name': 'volume-d90120d4-6779-48c4-84cc-09ced092b0ca', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf9d4a6-bbec-4d08-a2e5-70941b12be3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edf9d4a6-bbec-4d08-a2e5-70941b12be3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce685a8a-59d6-48a0-a0c5-f1c668c527bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Volume d90120d4-6779-48c4-84cc-09ced092b0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90120d4-6779-48c4-84cc-09ced092b0ca', 'volume_size': 1} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (9b000946-d20a-44bc-a74a-41ad58d94a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecf9288-4031-4724-ac8d-54abdd9aa7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecf9288-4031-4724-ac8d-54abdd9aa7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647673439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8128272-4915-4a28-a439-18df896fd2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:38Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cf6aac-4b49-46dc-a785-afc97d2f135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41cf6aac-4b49-46dc-a785-afc97d2f135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b7b8b-0afa-41ad-8455-918e17a62a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80b7b8b-0afa-41ad-8455-918e17a62a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8128272-4915-4a28-a439-18df896fd2f1', 'volume_name': 'volume-e8128272-4915-4a28-a439-18df896fd2f1', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0fac16-6399-452d-87cc-8d281a02b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0fac16-6399-452d-87cc-8d281a02b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a475ae8-f7fe-405e-a458-5dc379807476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:38 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Volume e8128272-4915-4a28-a439-18df896fd2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8128272-4915-4a28-a439-18df896fd2f1', 'volume_size': 1} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:38 devstack sudo[147407]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12" returned: 0 in 0.693s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.310s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-485408144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec0c833-b52b-4b3d-ba80-41c2edb79173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:37Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Creating volume bec0c833-b52b-4b3d-ba80-41c2edb79173 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:13:38 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f3bfdc-b511-48e3-915c-e3dafadfe35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:38 devstack sudo[147431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 1073741824 Jun 20 00:13:38 devstack sudo[147431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c5eb3-0a8f-496d-a45c-658d73179150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:38 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Volume volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 (c3ddc9b4-79a3-4728-8b96-e1341ff30c12): created successfully Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c5eb3-0a8f-496d-a45c-658d73179150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (6ba06595-b69c-47a6-9032-60a5248f6e33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:38 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d39c3abf-7882-4894-a58a-5c6cc6995736 tempest-CreateVolumesFromImageTest-13024189 None] Created volume successfully. Jun 20 00:13:39 devstack sudo[147431]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 1073741824" returned: 0 in 0.825s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:39 devstack sudo[147462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 Jun 20 00:13:39 devstack sudo[147462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:39 devstack sudo[147462]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173" returned: 0 in 0.633s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.454s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2240994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da8c04b-c3f4-4a57-b44e-b825b9c78a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:37Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Creating volume 6da8c04b-c3f4-4a57-b44e-b825b9c78a0b {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:13:39 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49279b18-fa46-4b9f-a089-1c4c57660863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec0c833-b52b-4b3d-ba80-41c2edb79173', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:39 devstack sudo[147484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b 1073741824 Jun 20 00:13:39 devstack sudo[147484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3d2a49-7546-4f6c-bd25-4c3977398d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:39 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Volume volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 (bec0c833-b52b-4b3d-ba80-41c2edb79173): created successfully Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3d2a49-7546-4f6c-bd25-4c3977398d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (d5a76c3e-6258-49d7-bd80-2beb2d057ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-11fd266e-3fc0-4e7d-8d9a-5c5cca862862 tempest-CreateVolumesFromImageTest-13024189 None] Created volume successfully. Jun 20 00:13:40 devstack sudo[147484]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b 1073741824" returned: 0 in 0.823s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:40 devstack sudo[147515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b Jun 20 00:13:40 devstack sudo[147515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:41 devstack sudo[147515]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b" returned: 0 in 0.646s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.602s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1562230599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90120d4-6779-48c4-84cc-09ced092b0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:38Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Creating volume d90120d4-6779-48c4-84cc-09ced092b0ca {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:13:41 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162ba468-b11a-4a08-be6d-6434282c7fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c20b672-1602-479c-811a-962a53b750c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:41 devstack sudo[147537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca 1073741824 Jun 20 00:13:41 devstack sudo[147537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:41 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Volume volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b (6da8c04b-c3f4-4a57-b44e-b825b9c78a0b): created successfully Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c20b672-1602-479c-811a-962a53b750c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (eb73b68f-a249-4b7b-8fdf-f7a707fcd159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:41 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-a1e3207b-ac9f-45aa-a26f-62ecf433aa5b tempest-CreateVolumesFromImageTest-13024189 None] Created volume successfully. Jun 20 00:13:42 devstack sudo[147537]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca 1073741824" returned: 0 in 0.838s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:42 devstack sudo[147570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca Jun 20 00:13:42 devstack sudo[147570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:42 devstack sudo[147570]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca" returned: 0 in 0.642s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.819s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647673439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8128272-4915-4a28-a439-18df896fd2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b8652163eb4bf39787b807916da8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:38Z,use_quota=True,user_id='e116367fc443441a94e4393de4f104d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Creating volume e8128272-4915-4a28-a439-18df896fd2f1 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:13:42 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce685a8a-59d6-48a0-a0c5-f1c668c527bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90120d4-6779-48c4-84cc-09ced092b0ca', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:42 devstack sudo[147591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 1073741824 Jun 20 00:13:42 devstack sudo[147591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb04395-17b0-43b6-8187-bec34fbae64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:42 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Volume volume-d90120d4-6779-48c4-84cc-09ced092b0ca (d90120d4-6779-48c4-84cc-09ced092b0ca): created successfully Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb04395-17b0-43b6-8187-bec34fbae64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (fc70951a-b701-4691-b00e-20e46d902e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:42 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3245adc6-d5de-42b7-ac89-5fee3752ca95 tempest-CreateVolumesFromImageTest-13024189 None] Created volume successfully. Jun 20 00:13:43 devstack sudo[147591]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 1073741824" returned: 0 in 0.786s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:43 devstack sudo[147623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 Jun 20 00:13:43 devstack sudo[147623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:44 devstack sudo[147623]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1" returned: 0 in 0.638s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a475ae8-f7fe-405e-a458-5dc379807476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8128272-4915-4a28-a439-18df896fd2f1', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e80047-54e9-401a-a846-3fd181a0e79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Volume volume-e8128272-4915-4a28-a439-18df896fd2f1 (e8128272-4915-4a28-a439-18df896fd2f1): created successfully Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e80047-54e9-401a-a846-3fd181a0e79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Flow 'volume_create_manager' (9b000946-d20a-44bc-a74a-41ad58d94a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-53f25b86-8353-427d-bcef-c31d04797dba tempest-CreateVolumesFromImageTest-13024189 None] Created volume successfully. Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-e8128272-4915-4a28-a439-18df896fd2f1-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-e8128272-4915-4a28-a439-18df896fd2f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-quobyte-e8128272-4915-4a28-a439-18df896fd2f1" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-e8128272-4915-4a28-a439-18df896fd2f1" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdaf5c48-3505-40fd-a7b6-10dbadfa54c1]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:44 devstack sudo[147651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 Jun 20 00:13:44 devstack sudo[147651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:45 devstack sudo[147651]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1" returned: 0 in 0.753s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:45 devstack sudo[147679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1 Jun 20 00:13:45 devstack sudo[147679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:45 devstack sudo[147679]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8128272-4915-4a28-a439-18df896fd2f1" returned: 0 in 0.638s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-e8128272-4915-4a28-a439-18df896fd2f1" released by "delete_volume" :: held 1.429s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Created reservations ['dcf9bd40-09c1-4b6c-8c15-14ac199d05c4', '9de4d346-1c1e-4185-a691-3c23729e61c2', 'e499205d-a508-4645-853b-2829f863d3c9', 'ac75f6ad-2cca-43a7-a4eb-30670ddf6d52'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:46 devstack sudo[147706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:13:46 devstack sudo[147706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-d90120d4-6779-48c4-84cc-09ced092b0ca-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-d90120d4-6779-48c4-84cc-09ced092b0ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:46 devstack sudo[147706]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.669s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-quobyte-d90120d4-6779-48c4-84cc-09ced092b0ca" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:46 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Deleted volume successfully. Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-d90120d4-6779-48c4-84cc-09ced092b0ca" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-72000cf0-0d6c-4f26-b47d-fefdf7cbea82 tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-e8128272-4915-4a28-a439-18df896fd2f1-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed98d609-a3c9-4981-8aaa-b809a23f27ab]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:46 devstack sudo[147731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca Jun 20 00:13:46 devstack sudo[147731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:47 devstack sudo[147731]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca" returned: 0 in 0.751s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:47 devstack sudo[147757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca Jun 20 00:13:47 devstack sudo[147757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:48 devstack sudo[147757]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-d90120d4-6779-48c4-84cc-09ced092b0ca" returned: 0 in 0.650s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-d90120d4-6779-48c4-84cc-09ced092b0ca" released by "delete_volume" :: held 1.452s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Created reservations ['4cd0716e-5a86-48c4-a20f-e5991b2d3c7f', 'fc5c3ac1-a4dd-40a0-91b3-ed2368a52b6e', 'c6402bee-ea6f-49e7-8c6d-ad061d8a8897', '13b1a7f4-fb46-4cf1-afbf-fb13310dc690'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:48 devstack sudo[147784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:13:48 devstack sudo[147784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-quobyte-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:49 devstack sudo[147784]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.662s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:49 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Deleted volume successfully. Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61e9a9d-4ab6-4f60-9ee9-81072a6c70a5]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-3c6a5f1b-1fc9-415b-ac0b-75a111998deb tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-d90120d4-6779-48c4-84cc-09ced092b0ca-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:49 devstack sudo[147808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b Jun 20 00:13:49 devstack sudo[147808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:49 devstack sudo[147808]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b" returned: 0 in 0.746s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:49 devstack sudo[147834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b Jun 20 00:13:49 devstack sudo[147834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:50 devstack sudo[147834]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b" returned: 0 in 0.643s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b" released by "delete_volume" :: held 1.432s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Created reservations ['c47192e4-6c5c-42fa-b5fb-52f228fdf768', '5bace4d7-969b-44b8-b3f2-195b3c0469dc', '53537f79-d90b-489d-95ff-7ebc60469fbc', 'a3da1e35-d356-4961-80f4-e12a419c69f7'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:50 devstack sudo[147861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:13:50 devstack sudo[147861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-bec0c833-b52b-4b3d-ba80-41c2edb79173-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-bec0c833-b52b-4b3d-ba80-41c2edb79173-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:51 devstack sudo[147861]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.649s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:13:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Deleted volume successfully. Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-quobyte-bec0c833-b52b-4b3d-ba80-41c2edb79173" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-487030c9-79b8-4ec7-8ef8-b6ee47988853 tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-6da8c04b-c3f4-4a57-b44e-b825b9c78a0b-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-bec0c833-b52b-4b3d-ba80-41c2edb79173" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f6441a-50da-4634-a480-4ecb7067316d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:51 devstack sudo[147885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 Jun 20 00:13:51 devstack sudo[147885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:52 devstack sudo[147885]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173" returned: 0 in 0.753s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:52 devstack sudo[147913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173 Jun 20 00:13:52 devstack sudo[147913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:52 devstack sudo[147913]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-bec0c833-b52b-4b3d-ba80-41c2edb79173" returned: 0 in 0.629s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-bec0c833-b52b-4b3d-ba80-41c2edb79173" released by "delete_volume" :: held 1.419s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Created reservations ['26c4ca14-4028-4eee-b705-60f1efbedab2', '46f89ead-ae90-40e3-a6a7-c0be7a86f5eb', 'bfc425ca-a88f-4260-8515-c650c3da0711', 'ac471d00-10e1-45a3-a274-fe5c74554f69'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:52 devstack sudo[147938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:13:52 devstack sudo[147938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-c3ddc9b4-79a3-4728-8b96-e1341ff30c12-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-c3ddc9b4-79a3-4728-8b96-e1341ff30c12-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:53 devstack sudo[147938]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.635s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:13:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Deleted volume successfully. Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "cinder-quobyte-c3ddc9b4-79a3-4728-8b96-e1341ff30c12" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9cd5c3d0-5d03-4594-8d75-6603b4e3c9db tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-bec0c833-b52b-4b3d-ba80-41c2edb79173-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-c3ddc9b4-79a3-4728-8b96-e1341ff30c12" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb2a834-be4b-45d0-8afc-7c78651e7dc7]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:13:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:53 devstack sudo[147962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 Jun 20 00:13:53 devstack sudo[147962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:54 devstack sudo[147962]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12" returned: 0 in 0.760s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:54 devstack sudo[147991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12 Jun 20 00:13:54 devstack sudo[147991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:54 devstack sudo[147991]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-c3ddc9b4-79a3-4728-8b96-e1341ff30c12" returned: 0 in 0.637s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-quobyte-c3ddc9b4-79a3-4728-8b96-e1341ff30c12" released by "delete_volume" :: held 1.435s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:54 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Created reservations ['e0b4b077-2b52-4704-85cf-2cade4fb6eea', '34f18510-6237-4e77-bfa0-9558bd3a267d', 'c39b482f-327e-42aa-8e85-60c2cb3b566e', 'ff775999-dd47-477b-9405-357be127c404'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:55 devstack sudo[148015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:13:55 devstack sudo[148015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:55 devstack sudo[148015]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.632s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:13:55 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Deleted volume successfully. Jun 20 00:13:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-9d7cc58e-dcc1-41a8-bb02-15ea826c4eae tempest-CreateVolumesFromImageTest-13024189 None] Lock "cinder-c3ddc9b4-79a3-4728-8b96-e1341ff30c12-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Flow 'volume_create_manager' (1ce661e1-1119-4ccb-abc9-7d6aeb38b564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155daece-4f30-47f4-a077-d891c3cba981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (155daece-4f30-47f4-a077-d891c3cba981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2123722675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba2e674-0e5f-48b7-b6fb-d23766f16ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8863fa978bb485ba944e1dd6ef040ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:58Z,use_quota=True,user_id='82dd4301912743798206a06af9206a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f0573e-8051-45c1-b29d-40c422edaf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f0573e-8051-45c1-b29d-40c422edaf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0382990-8b5a-4511-b46e-221c00e18f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0382990-8b5a-4511-b46e-221c00e18f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba2e674-0e5f-48b7-b6fb-d23766f16ff7', 'volume_name': 'volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab225dda-5532-4552-88c9-3b446ff734f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab225dda-5532-4552-88c9-3b446ff734f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb674991-986b-4a5d-99ba-10a76f96c36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:58 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Volume fba2e674-0e5f-48b7-b6fb-d23766f16ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7', 'volume_size': 1} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2123722675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba2e674-0e5f-48b7-b6fb-d23766f16ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8863fa978bb485ba944e1dd6ef040ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:13:58Z,use_quota=True,user_id='82dd4301912743798206a06af9206a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Creating volume fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:13:58 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:13:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:58 devstack sudo[148119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 1073741824 Jun 20 00:13:58 devstack sudo[148119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:59 devstack sudo[148119]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 1073741824" returned: 0 in 0.822s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:13:59 devstack sudo[148151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 Jun 20 00:13:59 devstack sudo[148151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:13:59 devstack sudo[148151]: pam_unix(sudo:session): session closed for user root Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" returned: 0 in 0.636s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb674991-986b-4a5d-99ba-10a76f96c36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5b6707-d1b9-483c-9aef-82976ebd206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:13:59 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Volume volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 (fba2e674-0e5f-48b7-b6fb-d23766f16ff7): created successfully Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5b6707-d1b9-483c-9aef-82976ebd206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:13:59 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Flow 'volume_create_manager' (1ce661e1-1119-4ccb-abc9-7d6aeb38b564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:13:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f33ac81a-6179-43b5-950e-d23dc1c14676 tempest-VolumeDependencyTests-274770499 None] Created volume successfully. Jun 20 00:14:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:00 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Creating offline snapshot 2530717e-8dae-449c-a757-e2e5d795382d of volume fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:14:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58051d9-f661-44b4-9c6c-afd3e8848d6d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:00 devstack sudo[148199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 Jun 20 00:14:00 devstack sudo[148199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:01 devstack sudo[148199]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" returned: 0 in 0.746s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:01 devstack sudo[148225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d 1G Jun 20 00:14:01 devstack sudo[148225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:02 devstack sudo[148225]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d 1G" returned: 0 in 0.785s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:02 devstack sudo[148255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d Jun 20 00:14:02 devstack sudo[148255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:02 devstack sudo[148255]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d" returned: 0 in 0.674s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:02 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d is being set with open permissions: ugo+rw Jun 20 00:14:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:02 devstack sudo[148281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d Jun 20 00:14:02 devstack sudo[148281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:03 devstack sudo[148281]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d" returned: 0 in 0.646s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:03 devstack sudo[148302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.info Jun 20 00:14:03 devstack sudo[148302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:04 devstack sudo[148302]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.info" returned: 0 in 0.646s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:04 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.info is being set with open permissions: ugo+rw Jun 20 00:14:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:04 devstack sudo[148326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.info Jun 20 00:14:04 devstack sudo[148326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:04 devstack sudo[148326]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.info" returned: 0 in 0.642s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.231s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8dad89e1-4f07-4a72-828f-b0ffcd11011b tempest-VolumeDependencyTests-274770499 None] Create snapshot completed successfully Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Flow 'volume_create_manager' (69c0acbc-96fb-44eb-bbf1-e6a5f4a0921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5768f73e-a42f-4b82-bffa-f410eccd0beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5768f73e-a42f-4b82-bffa-f410eccd0beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-711509625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aabc362-8565-4a96-9457-8540b9e8e1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8863fa978bb485ba944e1dd6ef040ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2530717e-8dae-449c-a757-e2e5d795382d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:06Z,use_quota=True,user_id='82dd4301912743798206a06af9206a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d6fcef-542e-4539-bff7-091a42dd2dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d6fcef-542e-4539-bff7-091a42dd2dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246b4a5d-c2a9-4ecd-ba9b-0e5508be8e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246b4a5d-c2a9-4ecd-ba9b-0e5508be8e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9aabc362-8565-4a96-9457-8540b9e8e1c3', 'volume_name': 'volume-9aabc362-8565-4a96-9457-8540b9e8e1c3', 'volume_size': 1, 'snapshot_id': '2530717e-8dae-449c-a757-e2e5d795382d'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f21afd-843e-4566-80c4-e797c0d09242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f21afd-843e-4566-80c4-e797c0d09242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f62a7ed-0797-4905-8a48-4e80a7faa288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:06 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Volume 9aabc362-8565-4a96-9457-8540b9e8e1c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9aabc362-8565-4a96-9457-8540b9e8e1c3', 'volume_size': 1, 'snapshot_id': '2530717e-8dae-449c-a757-e2e5d795382d'} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-quobyte-2530717e-8dae-449c-a757-e2e5d795382d-9aabc362-8565-4a96-9457-8540b9e8e1c3" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-2530717e-8dae-449c-a757-e2e5d795382d-9aabc362-8565-4a96-9457-8540b9e8e1c3" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Creating volume 9aabc362-8565-4a96-9457-8540b9e8e1c3 from snapshot 2530717e-8dae-449c-a757-e2e5d795382d {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-quobyte-9aabc362-8565-4a96-9457-8540b9e8e1c3" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-9aabc362-8565-4a96-9457-8540b9e8e1c3" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] snapshot: 2530717e-8dae-449c-a757-e2e5d795382d, volume: 9aabc362-8565-4a96-9457-8540b9e8e1c3, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[600d491b-28b2-469a-97d3-8b2926a104c2]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:06 devstack sudo[148398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d Jun 20 00:14:06 devstack sudo[148398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:07 devstack sudo[148398]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d" returned: 0 in 0.760s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[698f4d64-42ac-454e-9866-868fd56c10ff]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:07 devstack sudo[148425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 Jun 20 00:14:07 devstack sudo[148425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:07 devstack sudo[148425]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" returned: 0 in 0.783s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:14:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:07 devstack sudo[148455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 Jun 20 00:14:07 devstack sudo[148455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:12 devstack sudo[148455]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3" returned: 0 in 4.526s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:12 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6d9baf-cc37-4164-84b7-91aff6fcf181]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:12 devstack sudo[148606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 Jun 20 00:14:12 devstack sudo[148606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:13 devstack sudo[148606]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" returned: 0 in 0.902s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:13 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:14:13 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Converted 1024.00 MB image at 226.18 MB/s Jun 20 00:14:13 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 is being set with open permissions: ugo+rw Jun 20 00:14:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:13 devstack sudo[148638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 Jun 20 00:14:13 devstack sudo[148638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:13 devstack sudo[148638]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3" returned: 0 in 0.633s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-9aabc362-8565-4a96-9457-8540b9e8e1c3" released by "_copy_volume_from_snapshot" :: held 7.691s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-2530717e-8dae-449c-a757-e2e5d795382d-9aabc362-8565-4a96-9457-8540b9e8e1c3" released by "_create_volume_from_snapshot" :: held 7.717s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.731s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:13 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=53,cinder:INSERT=21,cinder:UPDATE=75,cinder:DELETE=6 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f62a7ed-0797-4905-8a48-4e80a7faa288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aabc362-8565-4a96-9457-8540b9e8e1c3', 'volume_size': 1, 'snapshot_id': '2530717e-8dae-449c-a757-e2e5d795382d'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c3f253-5e16-41af-98e1-a22bbf47ef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:14 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Volume volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 (9aabc362-8565-4a96-9457-8540b9e8e1c3): created successfully Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c3f253-5e16-41af-98e1-a22bbf47ef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Flow 'volume_create_manager' (69c0acbc-96fb-44eb-bbf1-e6a5f4a0921e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:14 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-4b0383d2-61cb-458f-9a6f-d6a3995095c8 tempest-VolumeDependencyTests-274770499 None] Created volume successfully. Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-2530717e-8dae-449c-a757-e2e5d795382d-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-2530717e-8dae-449c-a757-e2e5d795382d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-quobyte-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-quobyte-2530717e-8dae-449c-a757-e2e5d795382d" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-2530717e-8dae-449c-a757-e2e5d795382d" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Deleting offline snapshot 2530717e-8dae-449c-a757-e2e5d795382d of volume fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] snapshot_file for this snap is: volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89a582-0dd4-4fe2-9788-51295bc6752d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:15 devstack sudo[148692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d Jun 20 00:14:15 devstack sudo[148692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:15 devstack sudo[148692]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d" returned: 0 in 0.742s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:15 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:14:15 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0edaeee-09f5-40b5-9e53-6e7fe4b2cf61]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:15 devstack sudo[148719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 Jun 20 00:14:15 devstack sudo[148719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:16 devstack sudo[148719]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" returned: 0 in 0.741s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:16 devstack sudo[148748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d Jun 20 00:14:16 devstack sudo[148748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:17 devstack sudo[148748]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d" returned: 0 in 0.738s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:17 devstack sudo[148775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d Jun 20 00:14:17 devstack sudo[148775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:17 devstack sudo[148775]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7.2530717e-8dae-449c-a757-e2e5d795382d" returned: 0 in 0.632s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:17 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=73,cinder:SELECT=60,cinder:INSERT=21,cinder:DELETE=8 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:14:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-2530717e-8dae-449c-a757-e2e5d795382d" released by "_delete_snapshot" :: held 2.952s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" released by "delete_snapshot" :: held 2.973s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:17 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Created reservations ['4ac43c2e-96ac-48c0-8e79-cdc6aafd25a7', 'c0c78f96-b63f-4e36-8e63-3d5580c82020', 'd83665b6-f5d6-4cea-8945-6cdfa4ae5a97', '6007efa0-f4fa-458e-8284-02e0305bdcde'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Delete snapshot completed successfully. Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-345e3f5a-cdd9-4d88-afaf-1812067f49c5 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-2530717e-8dae-449c-a757-e2e5d795382d-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-fba2e674-0e5f-48b7-b6fb-d23766f16ff7-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-fba2e674-0e5f-48b7-b6fb-d23766f16ff7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-quobyte-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" acquired by "delete_volume" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3a674-b4dc-4947-97da-6e08a42caf4b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:18 devstack sudo[148808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 Jun 20 00:14:18 devstack sudo[148808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:18 devstack sudo[148808]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" returned: 0 in 0.751s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:18 devstack sudo[148834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7 Jun 20 00:14:18 devstack sudo[148834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:19 devstack sudo[148834]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" returned: 0 in 0.659s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-fba2e674-0e5f-48b7-b6fb-d23766f16ff7" released by "delete_volume" :: held 1.472s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Created reservations ['bbd03599-ab1d-4bad-b155-763e59b60b57', 'ef92fa78-1170-426d-907a-f1d85b695f0e', '69ce81b7-a4c9-4df6-ad8e-52b980457e8f', 'db9a5cf9-92a2-4e40-b811-3d387ded30e7'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:19 devstack sudo[148861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:19 devstack sudo[148861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-9aabc362-8565-4a96-9457-8540b9e8e1c3-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-9aabc362-8565-4a96-9457-8540b9e8e1c3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:20 devstack sudo[148861]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.641s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "cinder-quobyte-9aabc362-8565-4a96-9457-8540b9e8e1c3" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Deleted volume successfully. Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-9aabc362-8565-4a96-9457-8540b9e8e1c3" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-c44c892d-0211-44c0-828c-0cee9c972311 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-fba2e674-0e5f-48b7-b6fb-d23766f16ff7-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6ee5bb-a6e6-4743-8571-3d08b5fe74cc]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:20 devstack sudo[148886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 Jun 20 00:14:20 devstack sudo[148886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:21 devstack sudo[148886]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3" returned: 0 in 0.747s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:21 devstack sudo[148913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3 Jun 20 00:14:21 devstack sudo[148913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:21 devstack sudo[148913]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9aabc362-8565-4a96-9457-8540b9e8e1c3" returned: 0 in 0.657s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-quobyte-9aabc362-8565-4a96-9457-8540b9e8e1c3" released by "delete_volume" :: held 1.450s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Created reservations ['c21229f1-ac32-40c4-989b-26a95c26c515', 'b703f3a3-45a8-41f2-af29-2709b9ee3e61', 'c0457d75-395b-454c-afaf-01e794c01e91', '957a2f88-1761-44c9-8058-cdb96c1cd726'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:22 devstack sudo[148974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:22 devstack sudo[148974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:22 devstack sudo[148974]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.647s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:22 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:22 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Deleted volume successfully. Jun 20 00:14:22 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-08674e42-f5e6-444e-b465-2acb07554a05 tempest-VolumeDependencyTests-274770499 None] Lock "cinder-9aabc362-8565-4a96-9457-8540b9e8e1c3-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:28 devstack sudo[149184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:28 devstack sudo[149184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:28 devstack sudo[149184]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.665s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:14:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:14:31 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:14:32 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:DELETE=2,cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=24 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (7536fd41-84b6-45fc-84ad-26fa03553c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51c44d7-e472-4c37-aff0-adfb6b57b9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51c44d7-e472-4c37-aff0-adfb6b57b9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945112522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c509a12-05ab-46e6-84fd-5c5e095121c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:35Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92ab8d9-42fc-49e6-bf18-aad5324ad2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92ab8d9-42fc-49e6-bf18-aad5324ad2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a7d40f-934e-4da2-8080-104111a3c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a7d40f-934e-4da2-8080-104111a3c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c509a12-05ab-46e6-84fd-5c5e095121c8', 'volume_name': 'volume-7c509a12-05ab-46e6-84fd-5c5e095121c8', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbfbeab-3ba4-4610-ac7a-a24780897b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbfbeab-3ba4-4610-ac7a-a24780897b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47f44be-7662-434d-b5cb-2a9aea895a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Volume 7c509a12-05ab-46e6-84fd-5c5e095121c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c509a12-05ab-46e6-84fd-5c5e095121c8', 'volume_size': 1} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945112522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c509a12-05ab-46e6-84fd-5c5e095121c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:35Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Creating volume 7c509a12-05ab-46e6-84fd-5c5e095121c8 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:35 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:35 devstack sudo[149429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 1073741824 Jun 20 00:14:35 devstack sudo[149429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (488919c6-3dc7-4116-8664-0ebba725c7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d669899-c138-4c79-91af-ee7580ab33a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d669899-c138-4c79-91af-ee7580ab33a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571166377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac9d138-83a6-4432-b656-9d1036f4b66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:36Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b2985c-58cb-439c-8810-f5274ef70dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b2985c-58cb-439c-8810-f5274ef70dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35712208-8e35-4c75-ae98-771a2ffc23d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35712208-8e35-4c75-ae98-771a2ffc23d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac9d138-83a6-4432-b656-9d1036f4b66e', 'volume_name': 'volume-9ac9d138-83a6-4432-b656-9d1036f4b66e', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773d84ee-226e-45a2-8f40-3a5ac5992edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773d84ee-226e-45a2-8f40-3a5ac5992edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abc24b2-2bc0-4c06-9b6f-de43519fe8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:35 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Volume 9ac9d138-83a6-4432-b656-9d1036f4b66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac9d138-83a6-4432-b656-9d1036f4b66e', 'volume_size': 1} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:35 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (11f301ce-e2fa-4fce-9fd5-db63019b2213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d4d4a8-3e02-4bb6-8046-77569a0e88ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d4d4a8-3e02-4bb6-8046-77569a0e88ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-143410997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be625844-59f8-49b8-bbee-03c2a4c09b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:36Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75a30c7-c32f-4e71-bd1d-2c46938fe73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75a30c7-c32f-4e71-bd1d-2c46938fe73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9992886e-8f41-4740-bcc7-6b051d8d5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9992886e-8f41-4740-bcc7-6b051d8d5902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be625844-59f8-49b8-bbee-03c2a4c09b37', 'volume_name': 'volume-be625844-59f8-49b8-bbee-03c2a4c09b37', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c3a4f8-8ac0-4ae5-bad7-eb2f4a51ffb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c3a4f8-8ac0-4ae5-bad7-eb2f4a51ffb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5d8d64-5e9d-4474-b449-37801a5248a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume be625844-59f8-49b8-bbee-03c2a4c09b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be625844-59f8-49b8-bbee-03c2a4c09b37', 'volume_size': 1} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (daebb386-3d42-4a06-b183-b83ef0465b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384b4da8-c20c-481f-a13b-d771c92ac055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384b4da8-c20c-481f-a13b-d771c92ac055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013748328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c07b980-8814-4e45-bd2c-595dbab4b4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:36Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a875b2f-70f6-49dc-a074-ebc20108201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a875b2f-70f6-49dc-a074-ebc20108201f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5eae32-bf6e-40b7-a082-329c5bc84225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5eae32-bf6e-40b7-a082-329c5bc84225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c07b980-8814-4e45-bd2c-595dbab4b4e2', 'volume_name': 'volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18bbbb2-195a-4bbe-9aa3-bee74aa70db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18bbbb2-195a-4bbe-9aa3-bee74aa70db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1276dd58-2bdb-4cc6-84e9-a99d399c5921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Volume 7c07b980-8814-4e45-bd2c-595dbab4b4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2', 'volume_size': 1} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (b629009a-1b67-42e5-a993-069f7eed79bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1eb7a5-f9da-4beb-99e5-66aacc5daa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1eb7a5-f9da-4beb-99e5-66aacc5daa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-253741860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c35d81-3b6d-4bb8-9001-55cde3036737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:36Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b91c4aa-59ce-4134-a31b-079f06392af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b91c4aa-59ce-4134-a31b-079f06392af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1700f63-8488-4469-9db7-46bcabf1b398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1700f63-8488-4469-9db7-46bcabf1b398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c35d81-3b6d-4bb8-9001-55cde3036737', 'volume_name': 'volume-75c35d81-3b6d-4bb8-9001-55cde3036737', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a32588-7047-4b3c-a2e4-c2f8cc7be68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a32588-7047-4b3c-a2e4-c2f8cc7be68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8740845e-2615-4c6e-8a6d-474afbe77409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Volume 75c35d81-3b6d-4bb8-9001-55cde3036737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c35d81-3b6d-4bb8-9001-55cde3036737', 'volume_size': 1} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:36 devstack sudo[149429]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (682b5275-856c-4b76-87ea-427afc049cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a4cb07-bcea-496d-85d2-db473a7fb4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 1073741824" returned: 0 in 1.322s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a4cb07-bcea-496d-85d2-db473a7fb4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489151403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83b851a-e9cf-4491-8610-c8b2b15de63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:37Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84e64c9-3c1d-43b7-839c-b34a339b606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84e64c9-3c1d-43b7-839c-b34a339b606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672d6e83-d4c9-424a-b329-1997c99a9bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672d6e83-d4c9-424a-b329-1997c99a9bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83b851a-e9cf-4491-8610-c8b2b15de63e', 'volume_name': 'volume-a83b851a-e9cf-4491-8610-c8b2b15de63e', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2af3cc6-a1f0-443a-a092-3f6251e2f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2af3cc6-a1f0-443a-a092-3f6251e2f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb73797-ae75-46f1-9d3e-c18f439f0790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Volume a83b851a-e9cf-4491-8610-c8b2b15de63e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83b851a-e9cf-4491-8610-c8b2b15de63e', 'volume_size': 1} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:36 devstack sudo[149479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 Jun 20 00:14:36 devstack sudo[149479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:37 devstack sudo[149479]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8" returned: 0 in 0.721s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571166377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac9d138-83a6-4432-b656-9d1036f4b66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:36Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Creating volume 9ac9d138-83a6-4432-b656-9d1036f4b66e {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:37 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:37 devstack sudo[149503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e 1073741824 Jun 20 00:14:37 devstack sudo[149503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47f44be-7662-434d-b5cb-2a9aea895a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c509a12-05ab-46e6-84fd-5c5e095121c8', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b014ef54-559b-4cd0-972b-7be4fbad6cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:37 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Volume volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 (7c509a12-05ab-46e6-84fd-5c5e095121c8): created successfully Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b014ef54-559b-4cd0-972b-7be4fbad6cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:37 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (7536fd41-84b6-45fc-84ad-26fa03553c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:37 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7c023687-d478-4a18-9a70-23afd9cb69a0 tempest-CreateVolumesFromImageTest-28876694 None] Created volume successfully. Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Flow 'volume_create_manager' (3732228a-df8c-4396-9fe7-0b21f08e9601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88439b58-9865-4b6f-ad7e-6e197936d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88439b58-9865-4b6f-ad7e-6e197936d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6b2fdf-e401-41ef-abf5-9eee6d39677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d39f5a369e0402cb72cb04de694e8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:38Z,use_quota=True,user_id='51c7d9245b634e24a33e0594d7105319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0435e00-0420-4aa5-b9fa-268c14e663e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0435e00-0420-4aa5-b9fa-268c14e663e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941d522a-8e06-4581-89d4-85932f4b8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941d522a-8e06-4581-89d4-85932f4b8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad6b2fdf-e401-41ef-abf5-9eee6d39677c', 'volume_name': 'volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c', 'volume_size': 1, 'image_id': 'dc8db4fb-68f5-4429-81ce-d944d83072c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc8db4fb-68f5-4429-81ce-d944d83072c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db1b24d392e0c47b6133186714ee59e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d39f5a369e0402cb72cb04de694e8e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a21435b650a28b36593cfee0accbffec5a6561fec7c4088f1408b213bcb82fdb3767d36d32ee4f0cbb3d52f31bd9dd917f1b132735368eb3c11d5981d8bb7d3', 'id': 'dc8db4fb-68f5-4429-81ce-d944d83072c5', 'created_at': datetime.datetime(2026, 6, 19, 22, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 14, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc8db4fb-68f5-4429-81ce-d944d83072c5/file', 'properties': {}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941ed6b9-3075-4483-8001-e1e761dbc1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941ed6b9-3075-4483-8001-e1e761dbc1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c283d24-0a00-4af1-985e-d8f983452d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:38 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Volume ad6b2fdf-e401-41ef-abf5-9eee6d39677c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c', 'volume_size': 1, 'image_id': 'dc8db4fb-68f5-4429-81ce-d944d83072c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc8db4fb-68f5-4429-81ce-d944d83072c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db1b24d392e0c47b6133186714ee59e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d39f5a369e0402cb72cb04de694e8e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a21435b650a28b36593cfee0accbffec5a6561fec7c4088f1408b213bcb82fdb3767d36d32ee4f0cbb3d52f31bd9dd917f1b132735368eb3c11d5981d8bb7d3', 'id': 'dc8db4fb-68f5-4429-81ce-d944d83072c5', 'created_at': datetime.datetime(2026, 6, 19, 22, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 14, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc8db4fb-68f5-4429-81ce-d944d83072c5/file', 'properties': {}}, 'image_service': } Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Trying to clone ad6b2fdf-e401-41ef-abf5-9eee6d39677c from image dc8db4fb-68f5-4429-81ce-d944d83072c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dc8db4fb-68f5-4429-81ce-d944d83072c5', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:14:38 devstack sudo[149503]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e 1073741824" returned: 0 in 0.929s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:14:38 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Image download 0.00 MB at 0.00 MB/s Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:38 devstack sudo[149539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e Jun 20 00:14:38 devstack sudo[149539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1384d929-61b0-4778-80db-79b2f19c4d67]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:38 devstack sudo[149541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD Jun 20 00:14:38 devstack sudo[149541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Flow 'volume_create_manager' (f535a97a-7ed9-4baa-abdb-875638ad6955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24792f6-588c-41fd-b65a-994f43493aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24792f6-588c-41fd-b65a-994f43493aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a58fe3c-7635-42cf-8037-f871059259e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9671a3ab1847d1a261fe6aaabec584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:39Z,use_quota=True,user_id='543afa79e9184af5b4d2488ba6dcd866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3763a09c-f88e-45c4-88a4-c12729b40ebc),volume_type_id=3763a09c-f88e-45c4-88a4-c12729b40ebc)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed6831c-3a5a-4dd9-9c72-16899094fa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed6831c-3a5a-4dd9-9c72-16899094fa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6afb0a9-3f1c-4050-8d83-2273fe0c10d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.image.glance [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Creating Keystone auth plugin from conf {{(pid=93391) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 20 00:14:39 devstack sudo[149539]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e" returned: 0 in 0.785s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.288s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-143410997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be625844-59f8-49b8-bbee-03c2a4c09b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:36Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Creating volume be625844-59f8-49b8-bbee-03c2a4c09b37 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:39 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2abc24b2-2bc0-4c06-9b6f-de43519fe8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac9d138-83a6-4432-b656-9d1036f4b66e', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3740b22-db9e-4d24-b8f9-fc267e760b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:39 devstack sudo[149568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 1073741824 Jun 20 00:14:39 devstack sudo[149568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:39 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Volume volume-9ac9d138-83a6-4432-b656-9d1036f4b66e (9ac9d138-83a6-4432-b656-9d1036f4b66e): created successfully Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3740b22-db9e-4d24-b8f9-fc267e760b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (488919c6-3dc7-4116-8664-0ebba725c7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:39 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-2d8da33b-be26-4e16-b7b8-c3e748735b1a tempest-CreateVolumesFromImageTest-28876694 None] Created volume successfully. Jun 20 00:14:39 devstack sudo[149541]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6afb0a9-3f1c-4050-8d83-2273fe0c10d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a58fe3c-7635-42cf-8037-f871059259e3', 'volume_name': 'volume-9a58fe3c-7635-42cf-8037-f871059259e3', 'volume_size': 1, 'image_id': 'a43832b9-1fc0-4845-883f-a5958b101ab2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a43832b9-1fc0-4845-883f-a5958b101ab2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1248c3f333cc5237f5e61f8c30bf8269', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b9671a3ab1847d1a261fe6aaabec584', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a743ad6420e5a979ecc66fb9ab946c832af7395e278d910729176e0dafa2d44387f1b94f9737892219e9c45c80c40f4063c56e65700d7982eb5674d7b04681e', 'id': 'a43832b9-1fc0-4845-883f-a5958b101ab2', 'created_at': datetime.datetime(2026, 6, 19, 22, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a43832b9-1fc0-4845-883f-a5958b101ab2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2963229-aa04-4983-aab6-0ac8af060da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2963229-aa04-4983-aab6-0ac8af060da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b17e92-a14e-4dbc-b2f4-ec110136be31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:39 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Volume 9a58fe3c-7635-42cf-8037-f871059259e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a58fe3c-7635-42cf-8037-f871059259e3', 'volume_size': 1, 'image_id': 'a43832b9-1fc0-4845-883f-a5958b101ab2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a43832b9-1fc0-4845-883f-a5958b101ab2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1248c3f333cc5237f5e61f8c30bf8269', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b9671a3ab1847d1a261fe6aaabec584', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a743ad6420e5a979ecc66fb9ab946c832af7395e278d910729176e0dafa2d44387f1b94f9737892219e9c45c80c40f4063c56e65700d7982eb5674d7b04681e', 'id': 'a43832b9-1fc0-4845-883f-a5958b101ab2', 'created_at': datetime.datetime(2026, 6, 19, 22, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a43832b9-1fc0-4845-883f-a5958b101ab2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Trying to clone 9a58fe3c-7635-42cf-8037-f871059259e3 from image a43832b9-1fc0-4845-883f-a5958b101ab2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a43832b9-1fc0-4845-883f-a5958b101ab2', 'metadata': {}}]). {{(pid=93391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 20 00:14:39 devstack sudo[149575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD Jun 20 00:14:39 devstack sudo[149575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 20 00:14:39 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Image download 0.00 MB at 0.00 MB/s Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dd0044-e596-4eee-bf3e-2cdd40a69e08]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:39 devstack sudo[149586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD Jun 20 00:14:39 devstack sudo[149586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:40 devstack sudo[149568]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 1073741824" returned: 0 in 0.905s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:40 devstack sudo[149575]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD" returned: 1 in 0.837s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Temporary image dc8db4fb-68f5-4429-81ce-d944d83072c5 is fetched for user 51c7d9245b634e24a33e0594d7105319. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:14:40 devstack sudo[149610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 Jun 20 00:14:40 devstack sudo[149610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ac2fa5-e248-4dc5-80ee-761f7e2b3d40]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:40 devstack sudo[149615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD Jun 20 00:14:40 devstack sudo[149615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:40 devstack sudo[149586]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:40 devstack sudo[149622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD Jun 20 00:14:40 devstack sudo[149622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:41 devstack sudo[149610]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37" returned: 0 in 0.663s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.803s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013748328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c07b980-8814-4e45-bd2c-595dbab4b4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:36Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Creating volume 7c07b980-8814-4e45-bd2c-595dbab4b4e2 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:41 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:41 devstack sudo[149640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 1073741824 Jun 20 00:14:41 devstack sudo[149640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5d8d64-5e9d-4474-b449-37801a5248a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be625844-59f8-49b8-bbee-03c2a4c09b37', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb6e32c-3e6e-466e-91f5-2424e7aba41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:41 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume volume-be625844-59f8-49b8-bbee-03c2a4c09b37 (be625844-59f8-49b8-bbee-03c2a4c09b37): created successfully Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb6e32c-3e6e-466e-91f5-2424e7aba41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (11f301ce-e2fa-4fce-9fd5-db63019b2213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:41 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c24cc113-21fe-4034-b40e-6bce40d47095 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created volume successfully. Jun 20 00:14:41 devstack sudo[149615]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:41 devstack sudo[149622]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD" returned: 1 in 0.738s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Temporary image a43832b9-1fc0-4845-883f-a5958b101ab2 is fetched for user 543afa79e9184af5b4d2488ba6dcd866. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 20 00:14:41 devstack sudo[149653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD Jun 20 00:14:41 devstack sudo[149653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5832460f-3c56-4834-8a21-ce86bbc62d94]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:41 devstack sudo[149658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD Jun 20 00:14:41 devstack sudo[149658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:42 devstack sudo[149640]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 1073741824" returned: 0 in 0.952s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:42 devstack sudo[149653]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD" returned: 1 in 0.910s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:42 devstack sudo[149689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 Jun 20 00:14:42 devstack sudo[149689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (6c21671c-ba1b-4f90-bb8c-d8d34087e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c470db2-f0b9-4799-9183-42ce55192fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c470db2-f0b9-4799-9183-42ce55192fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565911181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837f5839-e77b-48fa-853e-13accd2d280a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:42Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeab728f-5d91-4c51-a8d7-573b055382b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeab728f-5d91-4c51-a8d7-573b055382b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a716aaa-6e51-4e8e-a319-323fa922c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a716aaa-6e51-4e8e-a319-323fa922c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837f5839-e77b-48fa-853e-13accd2d280a', 'volume_name': 'volume-837f5839-e77b-48fa-853e-13accd2d280a', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8be151-23cb-4ab2-87d3-c2e8e5d56f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b8be151-23cb-4ab2-87d3-c2e8e5d56f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47defb2-00d4-41c8-ac8e-30a5b1cb99d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume 837f5839-e77b-48fa-853e-13accd2d280a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837f5839-e77b-48fa-853e-13accd2d280a', 'volume_size': 1} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:42 devstack sudo[149658]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD" returned: 0 in 1.099s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (28b775de-3846-4b7e-a9ab-28734ae62856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5079ca-25da-4fd9-a6b4-91af94028bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack sudo[149706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD Jun 20 00:14:42 devstack sudo[149706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5079ca-25da-4fd9-a6b4-91af94028bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495298729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7e562f-33ac-486e-a051-67ef41e60ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:43Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb0b402-ece2-4ba3-8c5b-43333c75c67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb0b402-ece2-4ba3-8c5b-43333c75c67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58a8610-7a82-4523-8f1e-0fa7d93540a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d58a8610-7a82-4523-8f1e-0fa7d93540a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7e562f-33ac-486e-a051-67ef41e60ce1', 'volume_name': 'volume-5a7e562f-33ac-486e-a051-67ef41e60ce1', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc49747-cc21-416f-8c51-77a6b1f79a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc49747-cc21-416f-8c51-77a6b1f79a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6805bea7-dfa9-4530-a134-bc8893f9e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume 5a7e562f-33ac-486e-a051-67ef41e60ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7e562f-33ac-486e-a051-67ef41e60ce1', 'volume_size': 1} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (b9249341-9c06-4396-873a-ad2b1dbaaf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55408439-4142-4902-bad3-c9571ca0de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:42 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55408439-4142-4902-bad3-c9571ca0de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26046228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e0543b-73fb-4ecc-8928-951e3af0575a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:43Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5985869a-b19d-46d4-9041-aa153bc58a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5985869a-b19d-46d4-9041-aa153bc58a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf430797-dae3-4606-883a-2bf01ac826fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf430797-dae3-4606-883a-2bf01ac826fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e0543b-73fb-4ecc-8928-951e3af0575a', 'volume_name': 'volume-20e0543b-73fb-4ecc-8928-951e3af0575a', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack sudo[149689]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90a6bdb-c4c7-46da-a637-2e4a30d48fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90a6bdb-c4c7-46da-a637-2e4a30d48fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aef7aec-1aa7-4543-903c-f0aa7070462a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume 20e0543b-73fb-4ecc-8928-951e3af0575a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e0543b-73fb-4ecc-8928-951e3af0575a', 'volume_size': 1} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2" returned: 0 in 0.912s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.392s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-253741860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c35d81-3b6d-4bb8-9001-55cde3036737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:36Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Creating volume 75c35d81-3b6d-4bb8-9001-55cde3036737 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:43 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1276dd58-2bdb-4cc6-84e9-a99d399c5921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack sudo[149724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 1073741824 Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d7c6f4-d686-4f8b-9822-314f785d87a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack sudo[149724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:43 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Volume volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 (7c07b980-8814-4e45-bd2c-595dbab4b4e2): created successfully Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d7c6f4-d686-4f8b-9822-314f785d87a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (daebb386-3d42-4a06-b183-b83ef0465b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:43 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-05b57e8f-10f0-4dc3-ad10-2adb3519091d tempest-CreateVolumesFromImageTest-28876694 None] Created volume successfully. Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:43 devstack sudo[149706]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (78eab13d-f032-4d61-bc54-7e1d4f6645b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222b8136-43a9-4bc4-98cf-994ebd182b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD" returned: 1 in 1.006s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222b8136-43a9-4bc4-98cf-994ebd182b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188610435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6d4520-42e0-443f-abe2-a237b86dfe39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:43Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85251e26-e313-4ba6-94e4-4bbcfb89882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85251e26-e313-4ba6-94e4-4bbcfb89882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8051473-e818-4eb2-9abd-4085f7848988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8051473-e818-4eb2-9abd-4085f7848988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6d4520-42e0-443f-abe2-a237b86dfe39', 'volume_name': 'volume-8f6d4520-42e0-443f-abe2-a237b86dfe39', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b13b2b-9dfc-4dcf-b5e6-41e8e596f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b13b2b-9dfc-4dcf-b5e6-41e8e596f833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccc8b00-7f91-4d2c-b26c-0424e1dddef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume 8f6d4520-42e0-443f-abe2-a237b86dfe39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6d4520-42e0-443f-abe2-a237b86dfe39', 'volume_size': 1} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (16ab79ae-4dcd-49a9-837a-046ed7c746e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e7002-89a1-4d89-83a0-141d8e896dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e7002-89a1-4d89-83a0-141d8e896dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051753727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330c98c7-db59-432c-a4e7-2f4c6a1f79e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:44Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc628b4-2b52-4af3-8a59-9cd5e4175936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc628b4-2b52-4af3-8a59-9cd5e4175936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0ea55c-e17a-4d97-8d34-2b84c798a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0ea55c-e17a-4d97-8d34-2b84c798a814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330c98c7-db59-432c-a4e7-2f4c6a1f79e0', 'volume_name': 'volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84317d1f-5c10-4dc3-a1a4-b5b3501966b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84317d1f-5c10-4dc3-a1a4-b5b3501966b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40605325-bed0-4d19-a33b-f6d40c779838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:43 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume 330c98c7-db59-432c-a4e7-2f4c6a1f79e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0', 'volume_size': 1} Jun 20 00:14:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:44 devstack sudo[149724]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 1073741824" returned: 0 in 1.004s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:44 devstack sudo[149765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 Jun 20 00:14:44 devstack sudo[149765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:44 devstack sudo[149765]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737" returned: 0 in 0.644s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.812s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489151403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83b851a-e9cf-4491-8610-c8b2b15de63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf69dfe630644b3813a02fe2efcc2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:37Z,use_quota=True,user_id='b1018b15c6fb4baca85e08409febe3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Creating volume a83b851a-e9cf-4491-8610-c8b2b15de63e {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:44 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8740845e-2615-4c6e-8a6d-474afbe77409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c35d81-3b6d-4bb8-9001-55cde3036737', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:44 devstack sudo[149787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e 1073741824 Jun 20 00:14:44 devstack sudo[149787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f216a79-6f41-46f3-87b7-689ddc19b8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Volume volume-75c35d81-3b6d-4bb8-9001-55cde3036737 (75c35d81-3b6d-4bb8-9001-55cde3036737): created successfully Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f216a79-6f41-46f3-87b7-689ddc19b8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (b629009a-1b67-42e5-a993-069f7eed79bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1c66e7ef-615c-47a2-adf9-3139e89552d8 tempest-CreateVolumesFromImageTest-28876694 None] Created volume successfully. Jun 20 00:14:45 devstack sudo[149787]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e 1073741824" returned: 0 in 0.819s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:45 devstack sudo[149820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e Jun 20 00:14:45 devstack sudo[149820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:46 devstack sudo[149820]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e" returned: 0 in 0.648s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.068s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6b2fdf-e401-41ef-abf5-9eee6d39677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d39f5a369e0402cb72cb04de694e8e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:38Z,use_quota=True,user_id='51c7d9245b634e24a33e0594d7105319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Creating volume ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:46 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeb73797-ae75-46f1-9d3e-c18f439f0790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83b851a-e9cf-4491-8610-c8b2b15de63e', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80fe8da-136f-43c6-87df-a9a4ab8c7464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:46 devstack sudo[149842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c 1073741824 Jun 20 00:14:46 devstack sudo[149842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:46 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Volume volume-a83b851a-e9cf-4491-8610-c8b2b15de63e (a83b851a-e9cf-4491-8610-c8b2b15de63e): created successfully Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d80fe8da-136f-43c6-87df-a9a4ab8c7464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Flow 'volume_create_manager' (682b5275-856c-4b76-87ea-427afc049cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:46 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-3bb23df7-91f0-4c20-b755-4620d5b7a05c tempest-CreateVolumesFromImageTest-28876694 None] Created volume successfully. Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-a83b851a-e9cf-4491-8610-c8b2b15de63e-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-a83b851a-e9cf-4491-8610-c8b2b15de63e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-quobyte-a83b851a-e9cf-4491-8610-c8b2b15de63e" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-a83b851a-e9cf-4491-8610-c8b2b15de63e" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[903176f8-6a96-4984-9e41-23e63534ba0e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:46 devstack sudo[149864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e Jun 20 00:14:46 devstack sudo[149864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:47 devstack sudo[149842]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c 1073741824" returned: 0 in 0.877s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:47 devstack sudo[149877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c Jun 20 00:14:47 devstack sudo[149877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:47 devstack sudo[149864]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e" returned: 0 in 0.793s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:47 devstack sudo[149897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e Jun 20 00:14:47 devstack sudo[149897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:47 devstack sudo[149877]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" returned: 0 in 0.711s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.421s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565911181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837f5839-e77b-48fa-853e-13accd2d280a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:42Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Creating volume 837f5839-e77b-48fa-853e-13accd2d280a {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:47 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:47 devstack sudo[149906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a 1073741824 Jun 20 00:14:47 devstack sudo[149906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:47 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Attempting download of dc8db4fb-68f5-4429-81ce-d944d83072c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dc8db4fb-68f5-4429-81ce-d944d83072c5', 'metadata': {}}])) to volume ad6b2fdf-e401-41ef-abf5-9eee6d39677c. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbf6a0b-da57-4d99-879d-3f7d4cae4a74]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc8db4fb-68f5-4429-81ce-d944d83072c5_itzvemg4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:48 devstack sudo[149911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc8db4fb-68f5-4429-81ce-d944d83072c5_itzvemg4 Jun 20 00:14:48 devstack sudo[149911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:48 devstack sudo[149897]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-a83b851a-e9cf-4491-8610-c8b2b15de63e" returned: 0 in 0.710s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-a83b851a-e9cf-4491-8610-c8b2b15de63e" released by "delete_volume" :: held 1.556s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Created reservations ['c93b2f19-d9e1-467f-85e3-397374f2ceee', 'f104e31a-9011-4fd1-91ab-05cb4349ee66', '0bca47c2-da42-4438-aea3-1aa49e4aab17', 'd707c35f-83c4-4c7f-9138-6ccf504a748a'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:48 devstack sudo[149932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:48 devstack sudo[149932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:48 devstack sudo[149911]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc8db4fb-68f5-4429-81ce-d944d83072c5_itzvemg4" returned: 0 in 0.702s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc8db4fb-68f5-4429-81ce-d944d83072c5_itzvemg4 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:48 devstack sudo[149906]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a 1073741824" returned: 0 in 0.875s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:48 devstack sudo[149943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc8db4fb-68f5-4429-81ce-d944d83072c5_itzvemg4 Jun 20 00:14:48 devstack sudo[149943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:48 devstack sudo[149950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a Jun 20 00:14:48 devstack sudo[149950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-75c35d81-3b6d-4bb8-9001-55cde3036737-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-75c35d81-3b6d-4bb8-9001-55cde3036737-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-quobyte-75c35d81-3b6d-4bb8-9001-55cde3036737" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-75c35d81-3b6d-4bb8-9001-55cde3036737" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a0d6b8-afc2-4315-a917-2e8fea0488ce]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:49 devstack sudo[149965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 Jun 20 00:14:49 devstack sudo[149932]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:49 devstack sudo[149965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.829s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:49 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Deleted volume successfully. Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f4dda6d-7fff-4525-aef6-1e96512829ea tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-a83b851a-e9cf-4491-8610-c8b2b15de63e-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:49 devstack sudo[149943]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc8db4fb-68f5-4429-81ce-d944d83072c5_itzvemg4" returned: 1 in 0.886s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc8db4fb-68f5-4429-81ce-d944d83072c5_itzvemg4' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedf887d-b15e-43ac-a2a3-425c9043f0d8]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:49 devstack sudo[149950]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a" returned: 0 in 0.832s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.882s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-495298729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7e562f-33ac-486e-a051-67ef41e60ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:43Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Creating volume 5a7e562f-33ac-486e-a051-67ef41e60ce1 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:49 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:49 devstack sudo[149984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 1073741824 Jun 20 00:14:49 devstack sudo[149984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47defb2-00d4-41c8-ac8e-30a5b1cb99d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837f5839-e77b-48fa-853e-13accd2d280a', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:49 devstack sudo[149980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD Jun 20 00:14:49 devstack sudo[149980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db8b0f1-74ec-4ad2-9788-8edfd19e8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:49 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume volume-837f5839-e77b-48fa-853e-13accd2d280a (837f5839-e77b-48fa-853e-13accd2d280a): created successfully Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db8b0f1-74ec-4ad2-9788-8edfd19e8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (6c21671c-ba1b-4f90-bb8c-d8d34087e762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:49 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-9c4ee67d-415a-4abd-809c-68413cb678d9 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created volume successfully. Jun 20 00:14:50 devstack sudo[149965]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737" returned: 0 in 0.845s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:50 devstack sudo[150003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737 Jun 20 00:14:50 devstack sudo[150003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:50 devstack sudo[149980]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:50 devstack sudo[150019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD Jun 20 00:14:50 devstack sudo[150019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:50 devstack sudo[149984]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 1073741824" returned: 0 in 0.937s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:50 devstack sudo[150031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 Jun 20 00:14:50 devstack sudo[150031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:50 devstack sudo[150003]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-75c35d81-3b6d-4bb8-9001-55cde3036737" returned: 0 in 0.695s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-75c35d81-3b6d-4bb8-9001-55cde3036737" released by "delete_volume" :: held 1.631s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Created reservations ['6d0c9373-16ed-497d-97c5-795878387aec', 'b387445d-8c56-4d13-8b7b-15fffc98caf4', 'e1d5e26a-79d7-4e73-b6fe-bfdc026acb1d', '180a17b9-60d6-4536-a4ed-c3cab8f61086'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:50 devstack sudo[150039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:50 devstack sudo[150039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:51 devstack sudo[150019]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] dc8db4fb-68f5-4429-81ce-d944d83072c5 was raw, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:51 devstack sudo[150053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c Jun 20 00:14:51 devstack sudo[150053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-7c07b980-8814-4e45-bd2c-595dbab4b4e2-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-7c07b980-8814-4e45-bd2c-595dbab4b4e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:51 devstack sudo[150031]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1" returned: 0 in 0.777s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.388s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26046228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e0543b-73fb-4ecc-8928-951e3af0575a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:43Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Creating volume 20e0543b-73fb-4ecc-8928-951e3af0575a {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:51 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:51 devstack sudo[150065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a 1073741824 Jun 20 00:14:51 devstack sudo[150065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6805bea7-dfa9-4530-a134-bc8893f9e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7e562f-33ac-486e-a051-67ef41e60ce1', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4e8ecc-5ea2-456b-9d84-93813815db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-quobyte-7c07b980-8814-4e45-bd2c-595dbab4b4e2" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:51 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 (5a7e562f-33ac-486e-a051-67ef41e60ce1): created successfully Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4e8ecc-5ea2-456b-9d84-93813815db9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (28b775de-3846-4b7e-a9ab-28734ae62856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-7c07b980-8814-4e45-bd2c-595dbab4b4e2" acquired by "delete_volume" :: waited 0.040s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-92359dbd-0f45-463d-9dd8-bef27cbe2b9f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created volume successfully. Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa346f70-1256-4325-b75e-614ef0b19cba]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:51 devstack sudo[150039]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.781s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Deleted volume successfully. Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b4773eca-1081-445e-9787-2a2e1b317134 tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-75c35d81-3b6d-4bb8-9001-55cde3036737-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:51 devstack sudo[150071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 Jun 20 00:14:51 devstack sudo[150071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:51 devstack sudo[150053]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" returned: 0 in 0.802s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dc8db4fb-68f5-4429-81ce-d944d83072c5_phzc1tyndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:14:51 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Converted 0.00 MB image at 0.00 MB/s Jun 20 00:14:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:51 devstack sudo[150088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c 1G Jun 20 00:14:51 devstack sudo[150088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:52 devstack sudo[150065]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a 1073741824" returned: 0 in 0.921s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:52 devstack sudo[150108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a Jun 20 00:14:52 devstack sudo[150108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:52 devstack sudo[150071]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2" returned: 0 in 0.929s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:52 devstack sudo[150113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2 Jun 20 00:14:52 devstack sudo[150113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:52 devstack sudo[150088]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c 1G" returned: 0 in 0.739s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:52 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[217ae880-c3f9-48d7-b0a7-641486f9ed55]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:52 devstack sudo[150124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c Jun 20 00:14:52 devstack sudo[150124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:53 devstack sudo[150108]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a" returned: 0 in 0.677s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.539s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a58fe3c-7635-42cf-8037-f871059259e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9671a3ab1847d1a261fe6aaabec584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:39Z,use_quota=True,user_id='543afa79e9184af5b4d2488ba6dcd866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3763a09c-f88e-45c4-88a4-c12729b40ebc),volume_type_id=3763a09c-f88e-45c4-88a4-c12729b40ebc)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Creating volume 9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:53 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:53 devstack sudo[150140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 1073741824 Jun 20 00:14:53 devstack sudo[150140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aef7aec-1aa7-4543-903c-f0aa7070462a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e0543b-73fb-4ecc-8928-951e3af0575a', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774bddd9-2b02-4cae-8eec-f223bd1da6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:53 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume volume-20e0543b-73fb-4ecc-8928-951e3af0575a (20e0543b-73fb-4ecc-8928-951e3af0575a): created successfully Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774bddd9-2b02-4cae-8eec-f223bd1da6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (b9249341-9c06-4396-873a-ad2b1dbaaf6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:53 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e56af104-26fd-4cf7-93d5-98718e1dd834 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created volume successfully. Jun 20 00:14:53 devstack sudo[150113]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c07b980-8814-4e45-bd2c-595dbab4b4e2" returned: 0 in 0.763s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-7c07b980-8814-4e45-bd2c-595dbab4b4e2" released by "delete_volume" :: held 1.748s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Created reservations ['f8b687c6-d1e4-4725-a6db-508dbe6a3542', 'f6b2aa13-c7c0-4346-b3b6-6b2c3fb7aca4', '837a406b-436d-4e3c-83c7-5a5e4d026f1c', '147ea083-b29d-4910-923e-1ad86c760196'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:53 devstack sudo[150153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:53 devstack sudo[150153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:53 devstack sudo[150124]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" returned: 0 in 0.808s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-9ac9d138-83a6-4432-b656-9d1036f4b66e-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-9ac9d138-83a6-4432-b656-9d1036f4b66e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:53 devstack sudo[150158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c Jun 20 00:14:53 devstack sudo[150158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-quobyte-9ac9d138-83a6-4432-b656-9d1036f4b66e" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-9ac9d138-83a6-4432-b656-9d1036f4b66e" acquired by "delete_volume" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f3c27d-79ea-455b-9038-d18a319b7686]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:53 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:53 devstack sudo[150172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e Jun 20 00:14:53 devstack sudo[150172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:54 devstack sudo[150140]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 1073741824" returned: 0 in 0.942s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:54 devstack sudo[150185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 Jun 20 00:14:54 devstack sudo[150185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:54 devstack sudo[150153]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.810s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:54 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Deleted volume successfully. Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-30f0a0f5-17db-421e-a53a-53f5ccce285d tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-7c07b980-8814-4e45-bd2c-595dbab4b4e2-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:54 devstack sudo[150158]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" returned: 1 in 0.933s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Downloaded image dc8db4fb-68f5-4429-81ce-d944d83072c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/dc8db4fb-68f5-4429-81ce-d944d83072c5', 'metadata': {}}])) to volume ad6b2fdf-e401-41ef-abf5-9eee6d39677c successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Temporary image dc8db4fb-68f5-4429-81ce-d944d83072c5 for user 51c7d9245b634e24a33e0594d7105319 is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Marking volume ad6b2fdf-e401-41ef-abf5-9eee6d39677c as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Copying metadata from image dc8db4fb-68f5-4429-81ce-d944d83072c5 to ad6b2fdf-e401-41ef-abf5-9eee6d39677c. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Creating volume glance metadata for volume ad6b2fdf-e401-41ef-abf5-9eee6d39677c backed by image dc8db4fb-68f5-4429-81ce-d944d83072c5 with: {'image_id': 'dc8db4fb-68f5-4429-81ce-d944d83072c5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'db1b24d392e0c47b6133186714ee59e2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c283d24-0a00-4af1-985e-d8f983452d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c', 'volume_size': 1, 'image_id': 'dc8db4fb-68f5-4429-81ce-d944d83072c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc8db4fb-68f5-4429-81ce-d944d83072c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db1b24d392e0c47b6133186714ee59e2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1d39f5a369e0402cb72cb04de694e8e8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a21435b650a28b36593cfee0accbffec5a6561fec7c4088f1408b213bcb82fdb3767d36d32ee4f0cbb3d52f31bd9dd917f1b132735368eb3c11d5981d8bb7d3', 'id': 'dc8db4fb-68f5-4429-81ce-d944d83072c5', 'created_at': datetime.datetime(2026, 6, 19, 22, 14, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 14, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc8db4fb-68f5-4429-81ce-d944d83072c5/file', 'properties': {}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748ae1f0-d35a-40a3-bad9-f86580395f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:54 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Volume volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c (ad6b2fdf-e401-41ef-abf5-9eee6d39677c): created successfully Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748ae1f0-d35a-40a3-bad9-f86580395f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Flow 'volume_create_manager' (3732228a-df8c-4396-9fe7-0b21f08e9601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:54 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bc4feec0-1c15-40c3-8c30-ec2b65d6807d tempest-VolumeImageDependencyTests-393843654 None] Created volume successfully. Jun 20 00:14:54 devstack sudo[150172]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e" returned: 0 in 0.898s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:54 devstack sudo[150213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e Jun 20 00:14:54 devstack sudo[150213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:54 devstack sudo[150185]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3" returned: 0 in 0.759s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.247s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-188610435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6d4520-42e0-443f-abe2-a237b86dfe39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:43Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Creating volume 8f6d4520-42e0-443f-abe2-a237b86dfe39 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:54 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:54 devstack sudo[150222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 1073741824 Jun 20 00:14:54 devstack sudo[150222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Attempting download of a43832b9-1fc0-4845-883f-a5958b101ab2 ((None, [{'url': 'file:///opt/stack/data/glance/images/a43832b9-1fc0-4845-883f-a5958b101ab2', 'metadata': {}}])) to volume 9a58fe3c-7635-42cf-8037-f871059259e3. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52aa603-7244-42da-9461-479b5e788723]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a43832b9-1fc0-4845-883f-a5958b101ab2_8kyr1l6o {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:55 devstack sudo[150227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a43832b9-1fc0-4845-883f-a5958b101ab2_8kyr1l6o Jun 20 00:14:55 devstack sudo[150227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:55 devstack sudo[150213]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9ac9d138-83a6-4432-b656-9d1036f4b66e" returned: 0 in 0.703s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-9ac9d138-83a6-4432-b656-9d1036f4b66e" released by "delete_volume" :: held 1.678s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Acquiring lock "cinder-ad6b2fdf-e401-41ef-abf5-9eee6d39677c-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Lock "cinder-ad6b2fdf-e401-41ef-abf5-9eee6d39677c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Created reservations ['04e77a1a-2347-4aec-8c81-3271f50b4608', '070f8544-e48a-4355-bbec-2816e250f31f', '6d7d957a-fdc8-4d2d-9c5e-2a0215d0d784', '68286996-066a-4687-8d94-76ef5ef235af'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Acquiring lock "cinder-quobyte-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Lock "cinder-quobyte-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" acquired by "delete_volume" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3655cc9b-f486-4f69-a56f-864fa490ab89]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:55 devstack sudo[150257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:55 devstack sudo[150257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:55 devstack sudo[150227]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a43832b9-1fc0-4845-883f-a5958b101ab2_8kyr1l6o" returned: 0 in 0.816s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a43832b9-1fc0-4845-883f-a5958b101ab2_8kyr1l6o {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:55 devstack sudo[150259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c Jun 20 00:14:55 devstack sudo[150259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:55 devstack sudo[150222]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 1073741824" returned: 0 in 1.043s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:56 devstack sudo[150264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a43832b9-1fc0-4845-883f-a5958b101ab2_8kyr1l6o Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-7c509a12-05ab-46e6-84fd-5c5e095121c8-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:56 devstack sudo[150264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:56 devstack sudo[150270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 Jun 20 00:14:56 devstack sudo[150270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-7c509a12-05ab-46e6-84fd-5c5e095121c8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "cinder-quobyte-7c509a12-05ab-46e6-84fd-5c5e095121c8" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-7c509a12-05ab-46e6-84fd-5c5e095121c8" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0a1a3-a05a-4907-bd1d-1d2500276337]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:56 devstack sudo[150281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 Jun 20 00:14:56 devstack sudo[150281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:56 devstack sudo[150259]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" returned: 0 in 1.054s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:56 devstack sudo[150257]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.151s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:56 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Deleted volume successfully. Jun 20 00:14:56 devstack sudo[150264]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a43832b9-1fc0-4845-883f-a5958b101ab2_8kyr1l6o" returned: 1 in 1.084s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a43832b9-1fc0-4845-883f-a5958b101ab2_8kyr1l6o' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8bd840d2-b43c-45cc-9840-af63dd3e96ed tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-9ac9d138-83a6-4432-b656-9d1036f4b66e-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9462b5d-debb-4fe8-8528-9967daf52893]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:56 devstack sudo[150270]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39" returned: 0 in 0.948s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:56 devstack sudo[150304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c Jun 20 00:14:56 devstack sudo[150304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.958s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051753727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330c98c7-db59-432c-a4e7-2f4c6a1f79e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235559614e704ac3aef2154f1ed5e8be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:14:44Z,use_quota=True,user_id='0aa72bb304004f329561ed6a09371d88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Creating volume 330c98c7-db59-432c-a4e7-2f4c6a1f79e0 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:14:56 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccc8b00-7f91-4d2c-b26c-0424e1dddef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6d4520-42e0-443f-abe2-a237b86dfe39', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:56 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c770370-f94f-410a-8246-521149944a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:57 devstack sudo[150313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 1073741824 Jun 20 00:14:57 devstack sudo[150313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:57 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 (8f6d4520-42e0-443f-abe2-a237b86dfe39): created successfully Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c770370-f94f-410a-8246-521149944a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (78eab13d-f032-4d61-bc54-7e1d4f6645b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-79aa62fb-d45e-439b-9e7c-b595381df569 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created volume successfully. Jun 20 00:14:57 devstack sudo[150309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD Jun 20 00:14:57 devstack sudo[150309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:57 devstack sudo[150281]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8" returned: 0 in 1.094s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:57 devstack sudo[150332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8 Jun 20 00:14:57 devstack sudo[150332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:57 devstack sudo[150304]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" returned: 1 in 0.926s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:57 devstack sudo[150351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c Jun 20 00:14:57 devstack sudo[150351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:57 devstack sudo[150309]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD" returned: 0 in 0.910s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:57 devstack sudo[150313]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 1073741824" returned: 0 in 1.002s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:57 devstack sudo[150359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD Jun 20 00:14:57 devstack sudo[150359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:58 devstack sudo[150368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 Jun 20 00:14:58 devstack sudo[150368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:58 devstack sudo[150332]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-7c509a12-05ab-46e6-84fd-5c5e095121c8" returned: 0 in 0.845s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-quobyte-7c509a12-05ab-46e6-84fd-5c5e095121c8" released by "delete_volume" :: held 2.002s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Created reservations ['50fc2242-c82e-459f-8065-f7fc8df14ebc', '7bd7e113-2e2e-4bc3-bb0c-83c59e6e89d5', 'e21ea3b5-1cc0-43be-bf7f-1f92538c7310', 'c4f03ab6-1f05-4d96-97f9-21bec03943d4'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:58 devstack sudo[150381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:58 devstack sudo[150381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:58 devstack sudo[150351]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" returned: 0 in 0.793s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Lock "cinder-quobyte-ad6b2fdf-e401-41ef-abf5-9eee6d39677c" released by "delete_volume" :: held 2.870s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Created reservations ['bb064ab2-3e8b-4fae-930b-3b278b0838fb', 'f9835303-4521-4696-8d7a-2c76a868e2a2', '703a6e60-8134-45bd-b141-4cd1cd232e0f', 'a689e746-c347-43db-9ffe-e9bac1473555'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:58 devstack sudo[150395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:14:58 devstack sudo[150395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:58 devstack sudo[150359]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD" returned: 1 in 0.891s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] a43832b9-1fc0-4845-883f-a5958b101ab2 was raw, converting to raw {{(pid=93391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:58 devstack sudo[150399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 Jun 20 00:14:58 devstack sudo[150399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:58 devstack sudo[150368]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0" returned: 0 in 0.842s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40605325-bed0-4d19-a33b-f6d40c779838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e009ba29-94d7-4db7-991a-57976eb98176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:14:58 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Volume volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 (330c98c7-db59-432c-a4e7-2f4c6a1f79e0): created successfully Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e009ba29-94d7-4db7-991a-57976eb98176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:14:58 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Flow 'volume_create_manager' (16ab79ae-4dcd-49a9-837a-046ed7c746e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:14:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-17e7a60e-0aa3-4e89-ad6f-7d0d54417087 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created volume successfully. Jun 20 00:14:59 devstack sudo[150381]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-330c98c7-db59-432c-a4e7-2f4c6a1f79e0-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.900s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Deleted volume successfully. Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-330c98c7-db59-432c-a4e7-2f4c6a1f79e0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-f83ca14c-88d7-410e-86fc-5ab1121c93bf tempest-CreateVolumesFromImageTest-28876694 None] Lock "cinder-7c509a12-05ab-46e6-84fd-5c5e095121c8-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-quobyte-330c98c7-db59-432c-a4e7-2f4c6a1f79e0" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-330c98c7-db59-432c-a4e7-2f4c6a1f79e0" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5052b10-2cda-4d99-9cbd-aff75ca77ab5]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:59 devstack sudo[150395]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.961s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:14:59 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Deleted volume successfully. Jun 20 00:14:59 devstack sudo[150424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 Jun 20 00:14:59 devstack sudo[150424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-e89bcc15-7f2a-460f-9904-fa72bc9e0651 tempest-VolumeImageDependencyTests-393843654 None] Lock "cinder-ad6b2fdf-e401-41ef-abf5-9eee6d39677c-delete_volume" released by "delete_volume" :: held 4.122s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:14:59 devstack sudo[150399]: pam_unix(sudo:session): session closed for user root Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3" returned: 0 in 1.084s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a43832b9-1fc0-4845-883f-a5958b101ab2_raw97y8ydevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:14:59 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Converted 0.00 MB image at 0.00 MB/s Jun 20 00:14:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:14:59 devstack sudo[150440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 1G Jun 20 00:14:59 devstack sudo[150440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:00 devstack sudo[150424]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0" returned: 0 in 1.098s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:00 devstack sudo[150473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0 Jun 20 00:15:00 devstack sudo[150473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:00 devstack sudo[150440]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 1G" returned: 0 in 1.038s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:00 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36936f8-6210-4f55-948a-62aef29ab949]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:01 devstack sudo[150491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 Jun 20 00:15:01 devstack sudo[150491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:01 devstack sudo[150473]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-330c98c7-db59-432c-a4e7-2f4c6a1f79e0" returned: 0 in 0.972s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-330c98c7-db59-432c-a4e7-2f4c6a1f79e0" released by "delete_volume" :: held 2.131s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created reservations ['f5428490-3f41-43ab-9820-66cf4c445db9', 'f6afcdba-2042-4a55-8113-04f072a2d0af', '651776a1-7145-4595-b91b-238031730da3', '4d24efd8-881d-4549-a2ad-bdb7ebddd909'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:01 devstack sudo[150518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:01 devstack sudo[150518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:01 devstack sudo[150491]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3" returned: 0 in 1.038s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:02 devstack sudo[150531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 Jun 20 00:15:02 devstack sudo[150531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:02 devstack sudo[150518]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.782s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:02 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Deleted volume successfully. Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-4c9fe35d-b760-4bea-a5d4-dd56c433725c tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-330c98c7-db59-432c-a4e7-2f4c6a1f79e0-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-8f6d4520-42e0-443f-abe2-a237b86dfe39-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-8f6d4520-42e0-443f-abe2-a237b86dfe39-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-quobyte-8f6d4520-42e0-443f-abe2-a237b86dfe39" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-8f6d4520-42e0-443f-abe2-a237b86dfe39" acquired by "delete_volume" :: waited 0.031s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9b83a3-ee28-4e37-879f-17d5bad4fa73]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:02 devstack sudo[150531]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3" returned: 1 in 0.910s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Downloaded image a43832b9-1fc0-4845-883f-a5958b101ab2 ((None, [{'url': 'file:///opt/stack/data/glance/images/a43832b9-1fc0-4845-883f-a5958b101ab2', 'metadata': {}}])) to volume 9a58fe3c-7635-42cf-8037-f871059259e3 successfully. {{(pid=93391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Temporary image a43832b9-1fc0-4845-883f-a5958b101ab2 for user 543afa79e9184af5b4d2488ba6dcd866 is deleted. {{(pid=93391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.volume.volume_utils [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Marking volume 9a58fe3c-7635-42cf-8037-f871059259e3 as bootable. {{(pid=93391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Copying metadata from image a43832b9-1fc0-4845-883f-a5958b101ab2 to 9a58fe3c-7635-42cf-8037-f871059259e3. {{(pid=93391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Creating volume glance metadata for volume 9a58fe3c-7635-42cf-8037-f871059259e3 backed by image a43832b9-1fc0-4845-883f-a5958b101ab2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a43832b9-1fc0-4845-883f-a5958b101ab2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1248c3f333cc5237f5e61f8c30bf8269', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b17e92-a14e-4dbc-b2f4-ec110136be31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a58fe3c-7635-42cf-8037-f871059259e3', 'volume_size': 1, 'image_id': 'a43832b9-1fc0-4845-883f-a5958b101ab2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a43832b9-1fc0-4845-883f-a5958b101ab2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1248c3f333cc5237f5e61f8c30bf8269', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b9671a3ab1847d1a261fe6aaabec584', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a743ad6420e5a979ecc66fb9ab946c832af7395e278d910729176e0dafa2d44387f1b94f9737892219e9c45c80c40f4063c56e65700d7982eb5674d7b04681e', 'id': 'a43832b9-1fc0-4845-883f-a5958b101ab2', 'created_at': datetime.datetime(2026, 6, 19, 22, 14, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 22, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a43832b9-1fc0-4845-883f-a5958b101ab2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:02 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9930df2-489d-43a7-9b1b-4933b564ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:02 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Volume volume-9a58fe3c-7635-42cf-8037-f871059259e3 (9a58fe3c-7635-42cf-8037-f871059259e3): created successfully Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9930df2-489d-43a7-9b1b-4933b564ce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Flow 'volume_create_manager' (f535a97a-7ed9-4baa-abdb-875638ad6955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:03 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-87de76bd-b29f-4c95-9ea2-21fc84820719 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Created volume successfully. Jun 20 00:15:03 devstack sudo[150564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 Jun 20 00:15:03 devstack sudo[150564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Acquiring lock "cinder-9a58fe3c-7635-42cf-8037-f871059259e3-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "cinder-9a58fe3c-7635-42cf-8037-f871059259e3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Acquiring lock "cinder-quobyte-9a58fe3c-7635-42cf-8037-f871059259e3" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "cinder-quobyte-9a58fe3c-7635-42cf-8037-f871059259e3" acquired by "delete_volume" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Flow 'volume_create_manager' (7339d35e-9882-4445-978d-55c98a42e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9062d47-3b95-404b-9aef-5a683dba3ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba5da9b-2db9-434c-8ee0-0d356c3311ed]: (4, 'raw') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9062d47-3b95-404b-9aef-5a683dba3ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50d4efb-1005-439e-9f63-31ed4fc16e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8296946249934077b77acd1cf8aed78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:03Z,use_quota=True,user_id='e299b31acd914b1b90d06119b793afdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e612c-1a8b-43f1-95cf-7dd5f8fb28b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e612c-1a8b-43f1-95cf-7dd5f8fb28b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4508d1-5094-4d12-98d3-643e33341100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4508d1-5094-4d12-98d3-643e33341100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50d4efb-1005-439e-9f63-31ed4fc16e60', 'volume_name': 'volume-b50d4efb-1005-439e-9f63-31ed4fc16e60', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a71682-6fcc-49de-b4b6-390deb35eb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a71682-6fcc-49de-b4b6-390deb35eb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e3e765-04de-417c-a88c-80995e4deefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:03 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Volume b50d4efb-1005-439e-9f63-31ed4fc16e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50d4efb-1005-439e-9f63-31ed4fc16e60', 'volume_size': 1} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50d4efb-1005-439e-9f63-31ed4fc16e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8296946249934077b77acd1cf8aed78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:03Z,use_quota=True,user_id='e299b31acd914b1b90d06119b793afdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Creating volume b50d4efb-1005-439e-9f63-31ed4fc16e60 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:03 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:03 devstack sudo[150591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 1073741824 Jun 20 00:15:03 devstack sudo[150591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:03 devstack sudo[150587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 Jun 20 00:15:03 devstack sudo[150587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:04 devstack sudo[150564]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39" returned: 0 in 1.235s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:04 devstack sudo[150609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39 Jun 20 00:15:04 devstack sudo[150609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:04 devstack sudo[150587]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3" returned: 0 in 0.982s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:04 devstack sudo[150631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 Jun 20 00:15:04 devstack sudo[150631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:04 devstack sudo[150591]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 1073741824" returned: 0 in 1.197s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:04 devstack sudo[150609]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-8f6d4520-42e0-443f-abe2-a237b86dfe39" returned: 0 in 0.830s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:04 devstack sudo[150644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 Jun 20 00:15:04 devstack sudo[150644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-8f6d4520-42e0-443f-abe2-a237b86dfe39" released by "delete_volume" :: held 2.141s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created reservations ['49e70511-ecf2-4ac0-b6be-577b7e744f43', 'bf670b78-cdba-422d-84a2-8082c0f0ba76', '78d4540e-611c-4a0c-a502-51ddcff82352', 'a8793639-be16-4606-9c78-8f090977eef1'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:05 devstack sudo[150655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:05 devstack sudo[150655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:05 devstack sudo[150631]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3" returned: 1 in 1.024s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3' failed. Not Retrying. {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:05 devstack sudo[150673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3 Jun 20 00:15:05 devstack sudo[150673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:05 devstack sudo[150644]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60" returned: 0 in 0.779s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e3e765-04de-417c-a88c-80995e4deefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50d4efb-1005-439e-9f63-31ed4fc16e60', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c628fc-3659-440e-b600-6fb9b8f96869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:05 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Volume volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 (b50d4efb-1005-439e-9f63-31ed4fc16e60): created successfully Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c628fc-3659-440e-b600-6fb9b8f96869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Flow 'volume_create_manager' (7339d35e-9882-4445-978d-55c98a42e776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6fe3f3a4-5326-4644-a8fd-67390671ae70 tempest-CinderUnicodeTest-1839361839 None] Created volume successfully. Jun 20 00:15:05 devstack sudo[150655]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.821s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:05 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Deleted volume successfully. Jun 20 00:15:05 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-0ac10418-9b1b-4579-8788-6e291fd623b5 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-8f6d4520-42e0-443f-abe2-a237b86dfe39-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-20e0543b-73fb-4ecc-8928-951e3af0575a-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-20e0543b-73fb-4ecc-8928-951e3af0575a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-quobyte-20e0543b-73fb-4ecc-8928-951e3af0575a" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-20e0543b-73fb-4ecc-8928-951e3af0575a" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[048055cf-1ba1-411d-9df3-b2bd1ee88632]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:06 devstack sudo[150673]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9a58fe3c-7635-42cf-8037-f871059259e3" returned: 0 in 0.753s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "cinder-quobyte-9a58fe3c-7635-42cf-8037-f871059259e3" released by "delete_volume" :: held 2.853s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:06 devstack sudo[150699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a Jun 20 00:15:06 devstack sudo[150699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Created reservations ['af61e030-ef96-47b0-bb06-bacfc91444b6', '1e8897a4-7a5c-40e8-9e77-0cd91f9a4e09', '17d41797-8294-4a4b-8ab3-03039e80c573', 'beca04e9-58d1-4206-87bd-5f23917ade68'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:06 devstack sudo[150707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:06 devstack sudo[150707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:07 devstack sudo[150699]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a" returned: 0 in 1.089s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:07 devstack sudo[150707]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.899s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:07 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:07 devstack sudo[150737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a Jun 20 00:15:07 devstack sudo[150737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Deleted volume successfully. Jun 20 00:15:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-47953102-c4dc-4a4c-ae2f-42a35bf782c8 tempest-VolumeAndVolumeTypeFromImageTest-530448098 None] Lock "cinder-9a58fe3c-7635-42cf-8037-f871059259e3-delete_volume" released by "delete_volume" :: held 3.993s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Flow 'volume_create_manager' (536d8211-cfe4-441f-b535-346a6732e092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14a7abb-29a6-42ac-a1bc-87e86ef276a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14a7abb-29a6-42ac-a1bc-87e86ef276a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1014225221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98395baa-cb5b-46cc-b53c-fe0d2cf2ac46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8296946249934077b77acd1cf8aed78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:08Z,use_quota=True,user_id='e299b31acd914b1b90d06119b793afdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb23a2ae-c557-4a11-94e8-1d44e182c320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb23a2ae-c557-4a11-94e8-1d44e182c320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5471226d-9507-49b0-a891-66d467e9362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5471226d-9507-49b0-a891-66d467e9362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98395baa-cb5b-46cc-b53c-fe0d2cf2ac46', 'volume_name': 'volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08535275-733b-4052-9937-032e854de578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08535275-733b-4052-9937-032e854de578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267fd2fe-14bc-4bb5-b676-47a3906f80b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:08 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Volume 98395baa-cb5b-46cc-b53c-fe0d2cf2ac46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46', 'volume_size': 1} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1014225221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98395baa-cb5b-46cc-b53c-fe0d2cf2ac46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8296946249934077b77acd1cf8aed78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:08Z,use_quota=True,user_id='e299b31acd914b1b90d06119b793afdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Creating volume 98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:08 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:08 devstack sudo[150737]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:08 devstack sudo[150766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 1073741824 Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-20e0543b-73fb-4ecc-8928-951e3af0575a" returned: 0 in 0.878s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:08 devstack sudo[150766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-20e0543b-73fb-4ecc-8928-951e3af0575a" released by "delete_volume" :: held 2.011s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created reservations ['abf61d19-e805-4339-9f2f-33bff860a883', '7d2b9dff-d553-4a87-a77f-57111307c1ab', '13c818ed-32ef-4d43-a6cb-1438a2fd9e1d', '6fa2caa0-6000-4f4c-98f4-8f1f745fb742'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:08 devstack sudo[150775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:08 devstack sudo[150775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-5a7e562f-33ac-486e-a051-67ef41e60ce1-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-5a7e562f-33ac-486e-a051-67ef41e60ce1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-quobyte-5a7e562f-33ac-486e-a051-67ef41e60ce1" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-5a7e562f-33ac-486e-a051-67ef41e60ce1" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd0169f-5900-4761-8a67-135fc60ef1f4]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:09 devstack sudo[150792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 Jun 20 00:15:09 devstack sudo[150792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:09 devstack sudo[150775]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.071s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:09 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Deleted volume successfully. Jun 20 00:15:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-1eb3483f-1463-482b-9465-0d191ec1c74e tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-20e0543b-73fb-4ecc-8928-951e3af0575a-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:09 devstack sudo[150766]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 1073741824" returned: 0 in 1.555s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:09 devstack sudo[150824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 Jun 20 00:15:09 devstack sudo[150824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:10 devstack sudo[150792]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1" returned: 0 in 1.239s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:10 devstack sudo[150841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1 Jun 20 00:15:10 devstack sudo[150841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:10 devstack sudo[150824]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" returned: 0 in 1.042s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] <== create_volume: return (2653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.659s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267fd2fe-14bc-4bb5-b676-47a3906f80b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf56eee-7183-44c3-80bc-dabfb1822cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:10 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Volume volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 (98395baa-cb5b-46cc-b53c-fe0d2cf2ac46): created successfully Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cf56eee-7183-44c3-80bc-dabfb1822cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Flow 'volume_create_manager' (536d8211-cfe4-441f-b535-346a6732e092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:10 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-e4822511-c0d9-4428-8702-13988863c68e tempest-CinderUnicodeTest-1839361839 None] Created volume successfully. Jun 20 00:15:10 devstack sudo[150841]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-5a7e562f-33ac-486e-a051-67ef41e60ce1" returned: 0 in 0.867s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-5a7e562f-33ac-486e-a051-67ef41e60ce1" released by "delete_volume" :: held 2.184s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created reservations ['54871565-c85d-44c9-a210-55f90bebdffb', '80da8cf2-4c0e-479a-80fa-10c7d913975e', '0d2e5376-862c-48ec-b1d5-1949bef8501a', '6beeb8e2-a56e-4db4-a8f8-3b9c4149fab0'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:11 devstack sudo[150878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:11 devstack sudo[150878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Creating offline snapshot f1ffbe47-cefe-4311-ba8f-939cb229eb46 of volume 98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d14cbd0-7d0d-49ad-9532-ad8a61d3629d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:11 devstack sudo[150894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 Jun 20 00:15:11 devstack sudo[150894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:11 devstack sudo[150878]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.836s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:12 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Deleted volume successfully. Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d064e885-51a3-424a-9263-749a1481d313 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-5a7e562f-33ac-486e-a051-67ef41e60ce1-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-837f5839-e77b-48fa-853e-13accd2d280a-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-837f5839-e77b-48fa-853e-13accd2d280a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-quobyte-837f5839-e77b-48fa-853e-13accd2d280a" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-837f5839-e77b-48fa-853e-13accd2d280a" acquired by "delete_volume" :: waited 0.029s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda26b57-78ee-4ffd-9638-ab6bc5304ff6]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:12 devstack sudo[150918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a Jun 20 00:15:12 devstack sudo[150918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:12 devstack sudo[150894]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" returned: 0 in 1.215s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:12 devstack sudo[150940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 1G Jun 20 00:15:12 devstack sudo[150940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:13 devstack sudo[150918]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a" returned: 0 in 1.206s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:13 devstack sudo[150965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a Jun 20 00:15:13 devstack sudo[150965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:14 devstack sudo[150940]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 1G" returned: 0 in 1.232s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:14 devstack sudo[150989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 Jun 20 00:15:14 devstack sudo[150989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:14 devstack sudo[150965]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-837f5839-e77b-48fa-853e-13accd2d280a" returned: 0 in 1.032s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-837f5839-e77b-48fa-853e-13accd2d280a" released by "delete_volume" :: held 2.308s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created reservations ['26abeeb1-76fe-4bd3-9582-dcf90867bda4', 'bb76026e-76ed-4e04-9d41-fb3e545e2d1e', '16ab45a0-9b37-4688-a537-7e8c18acde5b', '7808f617-e75d-4980-9c73-6da6db981ab1'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:14 devstack sudo[151010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:14 devstack sudo[151010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:15 devstack sudo[150989]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46" returned: 0 in 1.095s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:15 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 is being set with open permissions: ugo+rw Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:15 devstack sudo[151030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 Jun 20 00:15:15 devstack sudo[151030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:15 devstack sudo[151010]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (1dcf2955-c5ef-4c68-bc4d-0b6093dd743d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73377c4b-d891-4451-bcd8-ba6b27f701a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-be625844-59f8-49b8-bbee-03c2a4c09b37-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.953s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73377c4b-d891-4451-bcd8-ba6b27f701a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024972063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b4b677-3bf8-4855-9fd4-21e711ec97e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:16Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2220475c-0c2d-491c-a9c9-22ce43825fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2220475c-0c2d-491c-a9c9-22ce43825fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c4c3ee-cbff-45cc-87ea-67d93f33d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c4c3ee-cbff-45cc-87ea-67d93f33d642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b4b677-3bf8-4855-9fd4-21e711ec97e3', 'volume_name': 'volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc15bbb-d9b2-4fee-84af-0b61c6fcc1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc15bbb-d9b2-4fee-84af-0b61c6fcc1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c87e94-9737-4e6e-8397-f51049850148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:15 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume e8b4b677-3bf8-4855-9fd4-21e711ec97e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3', 'volume_size': 1} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:15 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Deleted volume successfully. Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-be625844-59f8-49b8-bbee-03c2a4c09b37-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-d5aa44d8-e7c3-4078-ac53-9a6ed944341f tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-837f5839-e77b-48fa-853e-13accd2d280a-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "cinder-quobyte-be625844-59f8-49b8-bbee-03c2a4c09b37" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-be625844-59f8-49b8-bbee-03c2a4c09b37" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b191866f-9fc8-4bf7-ad3b-5d0c361854f7]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:15 devstack sudo[151053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 Jun 20 00:15:15 devstack sudo[151053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:16 devstack sudo[151030]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46" returned: 0 in 0.925s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:16 devstack sudo[151065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.info Jun 20 00:15:16 devstack sudo[151065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:16 devstack sudo[151053]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37" returned: 0 in 0.919s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:16 devstack sudo[151090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37 Jun 20 00:15:16 devstack sudo[151090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:16 devstack sudo[151065]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.info" returned: 0 in 0.736s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:16 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.info is being set with open permissions: ugo+rw Jun 20 00:15:16 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:16 devstack sudo[151095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.info Jun 20 00:15:16 devstack sudo[151095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:17 devstack sudo[151090]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-be625844-59f8-49b8-bbee-03c2a4c09b37" returned: 0 in 0.743s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-quobyte-be625844-59f8-49b8-bbee-03c2a4c09b37" released by "delete_volume" :: held 1.715s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Created reservations ['8a05c799-8542-4db2-9ce9-6c9cf8170a90', '25c71469-840b-4cb6-b105-00ff4ee23e51', '7ddfa2c0-8b60-4282-9c60-74136b354afa', '56c1137c-049a-4bae-b1ce-00f878d5636f'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:17 devstack sudo[151095]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.info" returned: 0 in 0.735s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.067s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.923s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024972063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b4b677-3bf8-4855-9fd4-21e711ec97e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:16Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Creating volume e8b4b677-3bf8-4855-9fd4-21e711ec97e3 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:17 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:17 devstack sudo[151123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 1073741824 Jun 20 00:15:17 devstack sudo[151123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:17 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bf722bf3-a6b3-42bf-8a96-c9290d2b0513 tempest-CinderUnicodeTest-1839361839 None] Create snapshot completed successfully Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:17 devstack sudo[151128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:17 devstack sudo[151128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:17 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "cinder-f1ffbe47-cefe-4311-ba8f-939cb229eb46-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-f1ffbe47-cefe-4311-ba8f-939cb229eb46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "cinder-quobyte-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-quobyte-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "cinder-quobyte-f1ffbe47-cefe-4311-ba8f-939cb229eb46" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-quobyte-f1ffbe47-cefe-4311-ba8f-939cb229eb46" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Deleting offline snapshot f1ffbe47-cefe-4311-ba8f-939cb229eb46 of volume 98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] snapshot_file for this snap is: volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a371f-9053-41c4-8691-dfbc00ad4665]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:18 devstack sudo[151142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 Jun 20 00:15:18 devstack sudo[151142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:18 devstack sudo[151128]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.993s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:18 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Deleted volume successfully. Jun 20 00:15:18 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-8684f919-8a23-475f-a7a4-6693bd1f8390 tempest-CreateVolumesFromSourceVolumeTest-1996540071 None] Lock "cinder-be625844-59f8-49b8-bbee-03c2a4c09b37-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:19 devstack sudo[151123]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 1073741824" returned: 0 in 1.376s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:19 devstack sudo[151177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 Jun 20 00:15:19 devstack sudo[151177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:19 devstack sudo[151142]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46" returned: 0 in 1.198s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:19 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:15:19 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ccd93a-a063-4bf3-9c06-143cdcfaf111]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:19 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:19 devstack sudo[151189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 Jun 20 00:15:19 devstack sudo[151189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:20 devstack sudo[151177]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" returned: 0 in 0.982s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c87e94-9737-4e6e-8397-f51049850148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155abac3-689e-4e87-ab88-e8d6e23f03e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:20 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 (e8b4b677-3bf8-4855-9fd4-21e711ec97e3): created successfully Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155abac3-689e-4e87-ab88-e8d6e23f03e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (1dcf2955-c5ef-4c68-bc4d-0b6093dd743d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:20 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-9c7b51af-79cb-46bc-982c-5550b7915dae tempest-CreateVolumesFromSnapshotTest-32890655 None] Created volume successfully. Jun 20 00:15:20 devstack sudo[151189]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" returned: 0 in 1.170s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:20 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:20 devstack sudo[151230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 Jun 20 00:15:20 devstack sudo[151230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:21 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Creating offline snapshot e1d45cc7-aa09-4c0c-824a-6e02f320f883 of volume e8b4b677-3bf8-4855-9fd4-21e711ec97e3 {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:15:21 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d6dfa5-41ec-4d7e-ab48-9fe0127cd784]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:21 devstack sudo[151258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 Jun 20 00:15:21 devstack sudo[151258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:21 devstack sudo[151230]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46" returned: 0 in 1.141s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:21 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:21 devstack sudo[151272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46 Jun 20 00:15:21 devstack sudo[151272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:22 devstack sudo[151258]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" returned: 0 in 1.352s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:22 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:22 devstack sudo[151342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 1G Jun 20 00:15:22 devstack sudo[151342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:23 devstack sudo[151272]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46.f1ffbe47-cefe-4311-ba8f-939cb229eb46" returned: 0 in 1.419s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-quobyte-f1ffbe47-cefe-4311-ba8f-939cb229eb46" released by "_delete_snapshot" :: held 5.097s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-quobyte-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" released by "delete_snapshot" :: held 5.152s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Flow 'volume_create_manager' (64b3ba90-fed4-48e9-85db-757dcef4badc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a4cc3c-c2fc-4087-a2a8-459b5a6d1da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a4cc3c-c2fc-4087-a2a8-459b5a6d1da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-859796349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da25c71c-8d39-49cd-9922-7a6ab79550ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034b81e3c6cd4ebca720b4e117772724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:23Z,use_quota=True,user_id='81e5565fba594a37bfbdb0f4e510298f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa74fa8-386c-4a4e-b115-8ac819426ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa74fa8-386c-4a4e-b115-8ac819426ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1375634-1544-4424-8f7c-777f9dd4f2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1375634-1544-4424-8f7c-777f9dd4f2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da25c71c-8d39-49cd-9922-7a6ab79550ab', 'volume_name': 'volume-da25c71c-8d39-49cd-9922-7a6ab79550ab', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3887f530-3d7b-4fe0-8d85-6768b837339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3887f530-3d7b-4fe0-8d85-6768b837339d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18559616-1188-46c5-9d01-ddc023d32f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:23 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Volume da25c71c-8d39-49cd-9922-7a6ab79550ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da25c71c-8d39-49cd-9922-7a6ab79550ab', 'volume_size': 1} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Created reservations ['50789257-7a8c-4d40-8899-3650b632e466', 'cf737b91-00c5-4dc2-b25c-d02588df05f9', '9ae3710d-33f3-4ed1-a8a2-830cc48b30a8', 'c17ae2d0-034d-46cc-a732-ab14962fc73d'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:23 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Delete snapshot completed successfully. Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7f27ed94-4b72-423b-9ae5-dbfa38054cf8 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-f1ffbe47-cefe-4311-ba8f-939cb229eb46-delete_snapshot" released by "delete_snapshot" :: held 5.449s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:23 devstack sudo[151342]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 1G" returned: 0 in 1.219s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:23 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:23 devstack sudo[151387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 Jun 20 00:15:23 devstack sudo[151387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "cinder-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "cinder-quobyte-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:24 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-quobyte-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" acquired by "delete_volume" :: waited 0.027s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:24 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4c5dbc-d509-49fe-8e87-f5d9016deb4a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:24 devstack sudo[151413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 Jun 20 00:15:24 devstack sudo[151413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:24 devstack sudo[151387]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883" returned: 0 in 0.939s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:24 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 is being set with open permissions: ugo+rw Jun 20 00:15:24 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:24 devstack sudo[151421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 Jun 20 00:15:24 devstack sudo[151421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:25 devstack sudo[151421]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883" returned: 0 in 0.734s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:25 devstack sudo[151413]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" returned: 0 in 0.962s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:25 devstack sudo[151452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46 Jun 20 00:15:25 devstack sudo[151452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:25 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:25 devstack sudo[151457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.info Jun 20 00:15:25 devstack sudo[151457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:26 devstack sudo[151452]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" returned: 0 in 0.864s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:26 devstack sudo[151457]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.info" returned: 0 in 0.825s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:26 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.info is being set with open permissions: ugo+rw Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-quobyte-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46" released by "delete_volume" :: held 1.915s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:26 devstack sudo[151485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.info Jun 20 00:15:26 devstack sudo[151485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Created reservations ['4863b902-9023-46f9-9bf0-6fd193b51d81', 'c518840b-8550-4f5f-88ba-cc0983306bfe', '964aac2f-2ee3-4caf-a780-def411268692', 'fdd14d8c-886f-4de9-a9cf-4c1ce7f26be4'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:26 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:26 devstack sudo[151493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:26 devstack sudo[151493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "cinder-b50d4efb-1005-439e-9f63-31ed4fc16e60-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-b50d4efb-1005-439e-9f63-31ed4fc16e60-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "cinder-quobyte-b50d4efb-1005-439e-9f63-31ed4fc16e60" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-quobyte-b50d4efb-1005-439e-9f63-31ed4fc16e60" acquired by "delete_volume" :: waited 0.037s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e07f98-2eb3-4b54-b712-e65f4d113879]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:27 devstack sudo[151507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 Jun 20 00:15:27 devstack sudo[151507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:27 devstack sudo[151485]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.info" returned: 0 in 1.032s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.316s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.304s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-859796349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da25c71c-8d39-49cd-9922-7a6ab79550ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034b81e3c6cd4ebca720b4e117772724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:23Z,use_quota=True,user_id='81e5565fba594a37bfbdb0f4e510298f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Creating volume da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:27 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-60f61b51-e2eb-4e67-a4c2-ad71603e1b6b tempest-CreateVolumesFromSnapshotTest-32890655 None] Create snapshot completed successfully Jun 20 00:15:27 devstack sudo[151524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab 1073741824 Jun 20 00:15:27 devstack sudo[151524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:27 devstack sudo[151493]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.926s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:27 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Deleted volume successfully. Jun 20 00:15:27 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-69bf8ba2-a523-428c-a0bd-ae90fc01e7b2 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-98395baa-cb5b-46cc-b53c-fe0d2cf2ac46-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:28 devstack sudo[151540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:28 devstack sudo[151540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:28 devstack sudo[151507]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60" returned: 0 in 0.930s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:28 devstack sudo[151545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60 Jun 20 00:15:28 devstack sudo[151545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Flow 'volume_create_manager' (6ed4ab21-44a2-4a48-b534-259532064188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f50f93-02c3-445f-b6c0-06bcbf349bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f50f93-02c3-445f-b6c0-06bcbf349bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1118885940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafe13f4-cc9a-4488-bc22-0f1bdada91ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e33bdfe78d497bbe3e5a6e036e3aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:28Z,use_quota=True,user_id='b07e2e6cf23b4db4a26c4293909cbc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b126c5cd-54aa-406c-a753-e8114c746bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b126c5cd-54aa-406c-a753-e8114c746bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67396c28-5f00-40fc-ab13-f62688e1b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67396c28-5f00-40fc-ab13-f62688e1b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eafe13f4-cc9a-4488-bc22-0f1bdada91ea', 'volume_name': 'volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cfe60d-1f3c-4ad4-8b4d-dca1df3dc16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cfe60d-1f3c-4ad4-8b4d-dca1df3dc16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6d428f-9286-44cd-89f5-8d30b2bfa2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:28 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Volume eafe13f4-cc9a-4488-bc22-0f1bdada91ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea', 'volume_size': 1} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:28 devstack sudo[151524]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab 1073741824" returned: 0 in 0.996s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:28 devstack sudo[151570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab Jun 20 00:15:28 devstack sudo[151570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:28 devstack sudo[151540]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.748s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 20 00:15:28 devstack sudo[151545]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-b50d4efb-1005-439e-9f63-31ed4fc16e60" returned: 0 in 0.752s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-quobyte-b50d4efb-1005-439e-9f63-31ed4fc16e60" released by "delete_volume" :: held 1.725s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:28 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Created reservations ['c3fa06aa-fe45-4635-84b3-f20f8330d6d5', 'edd32215-091d-483b-91c5-0f8787d74fdd', '37c2bffd-4b1b-47a3-b673-8cde951ba683', '4638a820-79a0-4443-ac20-00838de7a946'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:29 devstack sudo[151584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:29 devstack sudo[151584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (9b18d6bb-5552-436e-b567-c6c883e46b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d4b1b8-3661-49dc-b175-c29f506af16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d4b1b8-3661-49dc-b175-c29f506af16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1560352865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b34cd85-abed-45a7-af4b-35e72659ef87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:29Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafbc187-2c10-418d-b36f-73ddbf34940d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafbc187-2c10-418d-b36f-73ddbf34940d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11602971-f889-4866-8365-9c331a33191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11602971-f889-4866-8365-9c331a33191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b34cd85-abed-45a7-af4b-35e72659ef87', 'volume_name': 'volume-3b34cd85-abed-45a7-af4b-35e72659ef87', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebc678c-27f9-4f10-a8f7-90c7f3d1ac3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ebc678c-27f9-4f10-a8f7-90c7f3d1ac3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b219652d-e87d-40ad-9c0d-8ea96cef362c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume 3b34cd85-abed-45a7-af4b-35e72659ef87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b34cd85-abed-45a7-af4b-35e72659ef87', 'volume_size': 1} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:29 devstack sudo[151570]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab" returned: 0 in 0.969s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.358s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1118885940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafe13f4-cc9a-4488-bc22-0f1bdada91ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e33bdfe78d497bbe3e5a6e036e3aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:28Z,use_quota=True,user_id='b07e2e6cf23b4db4a26c4293909cbc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Creating volume eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:29 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18559616-1188-46c5-9d01-ddc023d32f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da25c71c-8d39-49cd-9922-7a6ab79550ab', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack sudo[151606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea 1073741824 Jun 20 00:15:29 devstack sudo[151606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a2af42-26f5-4fa5-88a0-1f5662b483da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (bb4388c0-b784-4b8c-9c41-d5620d81825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d726a6-54da-487e-a054-5396557c9f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Volume volume-da25c71c-8d39-49cd-9922-7a6ab79550ab (da25c71c-8d39-49cd-9922-7a6ab79550ab): created successfully Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a2af42-26f5-4fa5-88a0-1f5662b483da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Flow 'volume_create_manager' (64b3ba90-fed4-48e9-85db-757dcef4badc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:29 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7d9e121f-9868-4bee-8db2-d9f362d66025 tempest-VolumeDependencyTests-523593572 None] Created volume successfully. Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d726a6-54da-487e-a054-5396557c9f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267667185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158d5d3a-d50c-4a33-8eca-c749ee89056c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:30Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfee9df3-1abc-43e7-9669-9bcbde0bf559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfee9df3-1abc-43e7-9669-9bcbde0bf559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3c17b0-20cf-42a0-acf9-cb49c9b4ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a3c17b0-20cf-42a0-acf9-cb49c9b4ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158d5d3a-d50c-4a33-8eca-c749ee89056c', 'volume_name': 'volume-158d5d3a-d50c-4a33-8eca-c749ee89056c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9c863d-70b3-4f14-bbce-694cb27054c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc9c863d-70b3-4f14-bbce-694cb27054c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:29 devstack sudo[151584]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df634f7-faa0-4821-9bd2-a0e3b3903ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:29 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume 158d5d3a-d50c-4a33-8eca-c749ee89056c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158d5d3a-d50c-4a33-8eca-c749ee89056c', 'volume_size': 1} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.853s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:29 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Deleted volume successfully. Jun 20 00:15:29 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-dae8c409-5aae-48ea-b4dd-140392090d24 tempest-CinderUnicodeTest-1839361839 None] Lock "cinder-b50d4efb-1005-439e-9f63-31ed4fc16e60-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (0294a013-98d1-4838-ab6d-ecc2f6d7e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04584c80-d7f9-4ff0-ae47-85d3e0176abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04584c80-d7f9-4ff0-ae47-85d3e0176abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-62753127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a80307-aa5a-4270-b470-f88804aad7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:30Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184edd4b-ec16-4cda-bc97-520ac37111f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184edd4b-ec16-4cda-bc97-520ac37111f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a9d053-0777-462a-894a-dc14fe0e7828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66a9d053-0777-462a-894a-dc14fe0e7828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33a80307-aa5a-4270-b470-f88804aad7d7', 'volume_name': 'volume-33a80307-aa5a-4270-b470-f88804aad7d7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081bd3b8-6277-42e6-9b2a-ad336e291266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081bd3b8-6277-42e6-9b2a-ad336e291266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d02800-15ab-43d3-8514-935c3dcd9587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume 33a80307-aa5a-4270-b470-f88804aad7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33a80307-aa5a-4270-b470-f88804aad7d7', 'volume_size': 1} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (35ef20b2-c2e3-4620-aed8-b0bfdeb8948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fa050f-4441-40ed-ac13-ab9366872103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2fa050f-4441-40ed-ac13-ab9366872103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-735541109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73589454-b56c-4d79-9f66-205ba54f19de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:31Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d4a8d7-7389-408b-89a1-ed26a48909fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d4a8d7-7389-408b-89a1-ed26a48909fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aec063-67e7-439b-9e17-214173d026bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aec063-67e7-439b-9e17-214173d026bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73589454-b56c-4d79-9f66-205ba54f19de', 'volume_name': 'volume-73589454-b56c-4d79-9f66-205ba54f19de', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfe16c4-96d8-4a52-9ed5-707d7ea211c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:30 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfe16c4-96d8-4a52-9ed5-707d7ea211c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24ed8e1-37e7-491c-8643-014dd3bca942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:31 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume 73589454-b56c-4d79-9f66-205ba54f19de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73589454-b56c-4d79-9f66-205ba54f19de', 'volume_size': 1} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:31 devstack sudo[151606]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea 1073741824" returned: 0 in 1.386s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:31 devstack sudo[151654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea Jun 20 00:15:31 devstack sudo[151654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (13fab945-b4f9-4a89-b392-ad6257ef0c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1e59ff-7d9c-4786-8734-bdebfd279bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1e59ff-7d9c-4786-8734-bdebfd279bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1580652430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263e4366-3a4d-4346-a07d-1f19e5c453ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:31Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51c3c29-1d33-46f2-a27a-8a8646990704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51c3c29-1d33-46f2-a27a-8a8646990704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215a741d-8300-45e4-ab98-d8678a3ca5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215a741d-8300-45e4-ab98-d8678a3ca5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '263e4366-3a4d-4346-a07d-1f19e5c453ce', 'volume_name': 'volume-263e4366-3a4d-4346-a07d-1f19e5c453ce', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657766fc-50c2-479c-933a-f7f0442432cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657766fc-50c2-479c-933a-f7f0442432cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20361274-d76f-4815-b72d-ec875179b126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:31 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume 263e4366-3a4d-4346-a07d-1f19e5c453ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-263e4366-3a4d-4346-a07d-1f19e5c453ce', 'volume_size': 1} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:31 devstack sudo[151654]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" returned: 0 in 0.758s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.428s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1560352865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b34cd85-abed-45a7-af4b-35e72659ef87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:29Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Creating volume 3b34cd85-abed-45a7-af4b-35e72659ef87 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:31 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6d428f-9286-44cd-89f5-8d30b2bfa2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:31 devstack sudo[151678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 1073741824 Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f8c15-553f-4040-9e78-5004f167a2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:31 devstack sudo[151678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:31 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Volume volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea (eafe13f4-cc9a-4488-bc22-0f1bdada91ea): created successfully Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f8c15-553f-4040-9e78-5004f167a2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:31 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Flow 'volume_create_manager' (6ed4ab21-44a2-4a48-b534-259532064188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:31 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-d40ebe7f-bae2-4ae4-b039-a6b1b0b53e0e tempest-SnapshotDependencyTests-833580803 None] Created volume successfully. Jun 20 00:15:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:32 devstack sudo[151678]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 1073741824" returned: 0 in 0.881s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:32 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=135,cinder:UPDATE=179,cinder:INSERT=57,cinder:DELETE=19 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:15:32 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=201,cinder:SELECT=149,cinder:INSERT=46,cinder:DELETE=16 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:15:32 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:32 devstack sudo[151714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 Jun 20 00:15:32 devstack sudo[151714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:33 devstack sudo[151714]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87" returned: 0 in 0.671s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.563s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-267667185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158d5d3a-d50c-4a33-8eca-c749ee89056c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:30Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Creating volume 158d5d3a-d50c-4a33-8eca-c749ee89056c {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:33 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b219652d-e87d-40ad-9c0d-8ea96cef362c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b34cd85-abed-45a7-af4b-35e72659ef87', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7798e03-bacd-42a9-82fd-629383a16334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:33 devstack sudo[151735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c 1073741824 Jun 20 00:15:33 devstack sudo[151735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:33 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume volume-3b34cd85-abed-45a7-af4b-35e72659ef87 (3b34cd85-abed-45a7-af4b-35e72659ef87): created successfully Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7798e03-bacd-42a9-82fd-629383a16334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:33 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (9b18d6bb-5552-436e-b567-c6c883e46b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:33 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c5856ccd-616a-465f-acf3-f27c87349c58 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created volume successfully. Jun 20 00:15:34 devstack sudo[151735]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c 1073741824" returned: 0 in 0.814s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:34 devstack sudo[151768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c Jun 20 00:15:34 devstack sudo[151768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:34 devstack sudo[151768]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c" returned: 0 in 0.665s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.510s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-62753127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a80307-aa5a-4270-b470-f88804aad7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:30Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Creating volume 33a80307-aa5a-4270-b470-f88804aad7d7 {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:34 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:34 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:35 devstack sudo[151792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 1073741824 Jun 20 00:15:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df634f7-faa0-4821-9bd2-a0e3b3903ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158d5d3a-d50c-4a33-8eca-c749ee89056c', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:35 devstack sudo[151792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47246d13-8a2a-4356-9cfa-f47ca716e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:35 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume volume-158d5d3a-d50c-4a33-8eca-c749ee89056c (158d5d3a-d50c-4a33-8eca-c749ee89056c): created successfully Jun 20 00:15:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47246d13-8a2a-4356-9cfa-f47ca716e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:35 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (bb4388c0-b784-4b8c-9c41-d5620d81825e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:35 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-91ca53e6-6622-4368-87c6-acdc7b355ef9 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created volume successfully. Jun 20 00:15:35 devstack sudo[151792]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 1073741824" returned: 0 in 0.847s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:35 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:35 devstack sudo[151823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 Jun 20 00:15:35 devstack sudo[151823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:36 devstack sudo[151823]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7" returned: 0 in 0.629s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.506s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-735541109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73589454-b56c-4d79-9f66-205ba54f19de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:31Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Creating volume 73589454-b56c-4d79-9f66-205ba54f19de {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:36 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:36 devstack sudo[151847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de 1073741824 Jun 20 00:15:36 devstack sudo[151847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d02800-15ab-43d3-8514-935c3dcd9587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a80307-aa5a-4270-b470-f88804aad7d7', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6156d18-2c0b-4724-bffd-7bf7644d7d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:36 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume volume-33a80307-aa5a-4270-b470-f88804aad7d7 (33a80307-aa5a-4270-b470-f88804aad7d7): created successfully Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6156d18-2c0b-4724-bffd-7bf7644d7d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:36 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (0294a013-98d1-4838-ab6d-ecc2f6d7e13e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:36 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-8e846cfb-0a66-47ff-a9f3-0370b5f8ba99 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created volume successfully. Jun 20 00:15:37 devstack sudo[151847]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de 1073741824" returned: 0 in 0.852s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:37 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:37 devstack sudo[151877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de Jun 20 00:15:37 devstack sudo[151877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:38 devstack sudo[151877]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de" returned: 0 in 0.644s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.031s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c24ed8e1-37e7-491c-8643-014dd3bca942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73589454-b56c-4d79-9f66-205ba54f19de', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16277357-615d-424a-ab9c-0264c49ff2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Creating offline snapshot f80ae32d-4560-4877-b8e1-d5101fa9c466 of volume da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:15:38 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume volume-73589454-b56c-4d79-9f66-205ba54f19de (73589454-b56c-4d79-9f66-205ba54f19de): created successfully Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16277357-615d-424a-ab9c-0264c49ff2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (35ef20b2-c2e3-4620-aed8-b0bfdeb8948c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d826b59-5964-4591-9253-5e518350ab88]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:38 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-4a9f12e3-a3df-472a-afe3-e458624b43d7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created volume successfully. Jun 20 00:15:38 devstack sudo[151902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab Jun 20 00:15:38 devstack sudo[151902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:38 devstack sudo[151902]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab" returned: 0 in 0.767s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:38 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:38 devstack sudo[151929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 1G Jun 20 00:15:38 devstack sudo[151929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:39 devstack sudo[151929]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 1G" returned: 0 in 0.808s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:39 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da25c71c-8d39-49cd-9922-7a6ab79550ab -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:39 devstack sudo[151959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da25c71c-8d39-49cd-9922-7a6ab79550ab -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 Jun 20 00:15:39 devstack sudo[151959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:40 devstack sudo[151959]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da25c71c-8d39-49cd-9922-7a6ab79550ab -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466" returned: 0 in 0.709s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:40 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 is being set with open permissions: ugo+rw Jun 20 00:15:40 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:40 devstack sudo[151985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 Jun 20 00:15:40 devstack sudo[151985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:41 devstack sudo[151985]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466" returned: 0 in 0.642s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:41 devstack sudo[152009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.info Jun 20 00:15:41 devstack sudo[152009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:41 devstack sudo[152009]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.info" returned: 0 in 0.660s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:41 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.info is being set with open permissions: ugo+rw Jun 20 00:15:41 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:41 devstack sudo[152032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.info Jun 20 00:15:41 devstack sudo[152032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:42 devstack sudo[152032]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.info" returned: 0 in 0.629s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.327s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.911s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1580652430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=263e4366-3a4d-4346-a07d-1f19e5c453ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92bce0fc068548adb8c3de496bb31f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:31Z,use_quota=True,user_id='113b8c8be4454fce81e1dbdd4332993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)}" {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Creating volume 263e4366-3a4d-4346-a07d-1f19e5c453ce {{(pid=93391) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:42 devstack cinder-volume[93391]: INFO cinder.volume.drivers.remotefs [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] casted to osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 Jun 20 00:15:42 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce 1073741824 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:42 devstack sudo[152054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce 1073741824 Jun 20 00:15:42 devstack sudo[152054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:42 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-dd1916ed-5091-4bdb-9b98-370fb688b6e8 tempest-VolumeDependencyTests-523593572 None] Create snapshot completed successfully Jun 20 00:15:43 devstack sudo[152054]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce 1073741824" returned: 0 in 0.814s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:43 devstack sudo[152084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce Jun 20 00:15:43 devstack sudo[152084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:43 devstack sudo[152084]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce" returned: 0 in 0.680s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'} {{(pid=93391) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.284s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Creating offline snapshot e3f5ea67-c2d8-4101-9b02-e8def032e36e of volume eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20361274-d76f-4815-b72d-ec875179b126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-263e4366-3a4d-4346-a07d-1f19e5c453ce', 'volume_size': 1}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c027f0-1161-470b-8be0-10ac0d964480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:43 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Flow 'volume_create_manager' (a6007e6b-c9de-4dbb-92af-a5057fc1c405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb2c8b0-fe99-4c30-a350-77bceb958234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f34cd69-b785-4f10-92c1-be61fab69ad9]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb2c8b0-fe99-4c30-a350-77bceb958234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1288096710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b1d954-b0c8-47e0-94e1-4a1970ac3932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034b81e3c6cd4ebca720b4e117772724',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f80ae32d-4560-4877-b8e1-d5101fa9c466,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:44Z,use_quota=True,user_id='81e5565fba594a37bfbdb0f4e510298f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cc49a9-c29a-4afe-ae14-7566ee26530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cc49a9-c29a-4afe-ae14-7566ee26530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99f53a3-a763-4250-a8f8-65f0c1790a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99f53a3-a763-4250-a8f8-65f0c1790a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8b1d954-b0c8-47e0-94e1-4a1970ac3932', 'volume_name': 'volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932', 'volume_size': 1, 'snapshot_id': 'f80ae32d-4560-4877-b8e1-d5101fa9c466'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2201d52-2320-4687-98c3-ef45ca3a15f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2201d52-2320-4687-98c3-ef45ca3a15f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5353e935-409a-474a-8357-761c3429a0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Volume e8b1d954-b0c8-47e0-94e1-4a1970ac3932: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932', 'volume_size': 1, 'snapshot_id': 'f80ae32d-4560-4877-b8e1-d5101fa9c466'} Jun 20 00:15:44 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Volume volume-263e4366-3a4d-4346-a07d-1f19e5c453ce (263e4366-3a4d-4346-a07d-1f19e5c453ce): created successfully Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c027f0-1161-470b-8be0-10ac0d964480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Flow 'volume_create_manager' (13fab945-b4f9-4a89-b392-ad6257ef0c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:44 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-0f055622-2204-4fe9-bb35-67b6496d0618 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created volume successfully. Jun 20 00:15:44 devstack sudo[152111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea Jun 20 00:15:44 devstack sudo[152111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-263e4366-3a4d-4346-a07d-1f19e5c453ce-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-263e4366-3a4d-4346-a07d-1f19e5c453ce-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-quobyte-263e4366-3a4d-4346-a07d-1f19e5c453ce" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-263e4366-3a4d-4346-a07d-1f19e5c453ce" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc082cb4-f3bd-42f7-a913-e65f9d10a70b]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:44 devstack sudo[152122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce Jun 20 00:15:44 devstack sudo[152122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:44 devstack sudo[152111]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" returned: 0 in 0.767s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:44 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e 1G {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:44 devstack sudo[152142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e 1G Jun 20 00:15:44 devstack sudo[152142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:45 devstack sudo[152122]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce" returned: 0 in 0.783s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:45 devstack sudo[152156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce Jun 20 00:15:45 devstack sudo[152156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:45 devstack sudo[152142]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e 1G" returned: 0 in 0.777s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:45 devstack sudo[152177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e Jun 20 00:15:45 devstack sudo[152177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:45 devstack sudo[152156]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-263e4366-3a4d-4346-a07d-1f19e5c453ce" returned: 0 in 0.660s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-263e4366-3a4d-4346-a07d-1f19e5c453ce" released by "delete_volume" :: held 1.485s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created reservations ['d2ad38cb-0200-4ba0-bda7-d6726ad79f09', '467a4207-796b-4b23-aba3-a563bf43991d', 'ca811cc8-8763-487f-8b3c-05f9690335f8', 'c1f0a78d-d057-4ea7-b55b-aa57bdc37a54'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:45 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:45 devstack sudo[152190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:45 devstack sudo[152190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:46 devstack sudo[152177]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea -F qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e" returned: 0 in 0.699s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:46 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e is being set with open permissions: ugo+rw Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:46 devstack sudo[152207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e Jun 20 00:15:46 devstack sudo[152207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-73589454-b56c-4d79-9f66-205ba54f19de-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-73589454-b56c-4d79-9f66-205ba54f19de-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-quobyte-73589454-b56c-4d79-9f66-205ba54f19de" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-73589454-b56c-4d79-9f66-205ba54f19de" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d8c68f-81ed-4e0f-b396-e7422300190a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:46 devstack sudo[152190]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.719s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:46 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Deleted volume successfully. Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6641023e-b20d-4994-9b47-f0d0e5b5ea06 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-263e4366-3a4d-4346-a07d-1f19e5c453ce-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:46 devstack sudo[152219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de Jun 20 00:15:46 devstack sudo[152219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:46 devstack sudo[152207]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:46 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e" returned: 0 in 0.699s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:47 devstack sudo[152234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.info Jun 20 00:15:47 devstack sudo[152234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:47 devstack sudo[152219]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de" returned: 0 in 0.802s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:47 devstack sudo[152251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de Jun 20 00:15:47 devstack sudo[152251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:47 devstack sudo[152234]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.info" returned: 0 in 0.684s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:47 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.info is being set with open permissions: ugo+rw Jun 20 00:15:47 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.info {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:47 devstack sudo[152263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.info Jun 20 00:15:47 devstack sudo[152263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:48 devstack sudo[152251]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-73589454-b56c-4d79-9f66-205ba54f19de" returned: 0 in 0.666s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-73589454-b56c-4d79-9f66-205ba54f19de" released by "delete_volume" :: held 1.518s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created reservations ['260bf940-2b4f-4e96-9aa8-467ce77d9aee', '3e473b35-0f9b-4547-9141-ec3e83df4e22', '66908157-4524-4c2c-a1f9-24f247fa1fe5', 'b2b2051a-5943-4853-b025-273170952042'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:48 devstack sudo[152281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:48 devstack sudo[152281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:48 devstack sudo[152263]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.info" returned: 0 in 0.653s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.259s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-quobyte-f80ae32d-4560-4877-b8e1-d5101fa9c466-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-f80ae32d-4560-4877-b8e1-d5101fa9c466-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Creating volume e8b1d954-b0c8-47e0-94e1-4a1970ac3932 from snapshot f80ae32d-4560-4877-b8e1-d5101fa9c466 {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-quobyte-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:48 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-c1007fa2-2ec2-4861-87cd-404b6542245e tempest-SnapshotDependencyTests-833580803 None] Create snapshot completed successfully Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] snapshot: f80ae32d-4560-4877-b8e1-d5101fa9c466, volume: e8b1d954-b0c8-47e0-94e1-4a1970ac3932, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0a144-2110-4a9e-9f52-ae9b12543b36]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:48 devstack sudo[152290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 Jun 20 00:15:48 devstack sudo[152290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-33a80307-aa5a-4270-b470-f88804aad7d7-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-33a80307-aa5a-4270-b470-f88804aad7d7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-quobyte-33a80307-aa5a-4270-b470-f88804aad7d7" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-33a80307-aa5a-4270-b470-f88804aad7d7" acquired by "delete_volume" :: waited 0.016s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d4a81e-a039-4ebd-bfbd-48c660d5128d]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:48 devstack sudo[152281]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.697s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:48 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Deleted volume successfully. Jun 20 00:15:48 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-39ff7f55-b1cf-4e1b-a330-a956ac4314d0 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-73589454-b56c-4d79-9f66-205ba54f19de-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:48 devstack sudo[152305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 Jun 20 00:15:48 devstack sudo[152305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:49 devstack sudo[152290]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466" returned: 0 in 0.850s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da25c71c-8d39-49cd-9922-7a6ab79550ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdfaff5-3f06-49fc-9d2d-522ad0e9fcab]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:49 devstack sudo[152325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab Jun 20 00:15:49 devstack sudo[152325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:49 devstack sudo[152305]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7" returned: 0 in 0.850s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:49 devstack sudo[152342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7 Jun 20 00:15:49 devstack sudo[152342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Flow 'volume_create_manager' (56be0866-cb23-48c0-bfe5-15c9cad72670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e425a7-d606-4dc8-ba87-ecde415a141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e425a7-d606-4dc8-ba87-ecde415a141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T22:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6465a7-0aaf-469e-bce4-89ffdd46e681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e33bdfe78d497bbe3e5a6e036e3aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T22:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3f5ea67-c2d8-4101-9b02-e8def032e36e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T22:15:50Z,use_quota=True,user_id='b07e2e6cf23b4db4a26c4293909cbc6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea51c2ac-4df9-4682-83fc-dabf64bbbb00),volume_type_id=ea51c2ac-4df9-4682-83fc-dabf64bbbb00)' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c06ac77-3097-41ea-83ed-8f3ab2cc9a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c06ac77-3097-41ea-83ed-8f3ab2cc9a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4eeb05-91f3-4966-a147-a11f2fc8c0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4eeb05-91f3-4966-a147-a11f2fc8c0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f6465a7-0aaf-469e-bce4-89ffdd46e681', 'volume_name': 'volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681', 'volume_size': 1, 'snapshot_id': 'e3f5ea67-c2d8-4101-9b02-e8def032e36e'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2162ddee-bee3-4450-b629-0bd11517daa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2162ddee-bee3-4450-b629-0bd11517daa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2879efad-3688-477d-ab3b-2cb908889999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:49 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Volume 9f6465a7-0aaf-469e-bce4-89ffdd46e681: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681', 'volume_size': 1, 'snapshot_id': 'e3f5ea67-c2d8-4101-9b02-e8def032e36e'} Jun 20 00:15:49 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:50 devstack sudo[152325]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab" returned: 0 in 0.854s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:50 devstack sudo[152361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 Jun 20 00:15:50 devstack sudo[152361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:50 devstack sudo[152342]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-33a80307-aa5a-4270-b470-f88804aad7d7" returned: 0 in 0.700s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-33a80307-aa5a-4270-b470-f88804aad7d7" released by "delete_volume" :: held 1.601s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Created reservations ['75924b04-1e2e-46c8-9597-afbef12cc1b4', '3ed64fd9-1a9b-4896-b098-e7f5dfe2af90', '6e1f026d-9705-428c-8185-4c1951dc14a3', '0dfaef6c-36a7-445d-8a8d-293254616f03'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:50 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:50 devstack sudo[152374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:50 devstack sudo[152374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-158d5d3a-d50c-4a33-8eca-c749ee89056c-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-158d5d3a-d50c-4a33-8eca-c749ee89056c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-quobyte-158d5d3a-d50c-4a33-8eca-c749ee89056c" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-158d5d3a-d50c-4a33-8eca-c749ee89056c" acquired by "delete_volume" :: waited 0.038s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d15db4-9801-425e-ade9-b398d501a6cf]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:51 devstack sudo[152374]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.944s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:51 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Deleted volume successfully. Jun 20 00:15:51 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-b8bfe6cb-3f48-470f-acea-2d7951a7e94c tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-33a80307-aa5a-4270-b470-f88804aad7d7-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:51 devstack sudo[152411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c Jun 20 00:15:51 devstack sudo[152411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:52 devstack sudo[152411]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c" returned: 0 in 1.365s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:52 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:52 devstack sudo[152456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c Jun 20 00:15:52 devstack sudo[152456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:54 devstack sudo[152456]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-158d5d3a-d50c-4a33-8eca-c749ee89056c" returned: 0 in 1.796s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-158d5d3a-d50c-4a33-8eca-c749ee89056c" released by "delete_volume" :: held 3.266s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created reservations ['abb77448-f51b-4a99-a5b7-3c078b673565', 'e03162a7-e816-4311-aead-aaf92ec2eae2', '481139b2-6cbe-4804-acfd-f0f30cf43055', 'b02f6e90-edcd-458f-b5cd-e33ee1ed165c'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:54 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:55 devstack sudo[152524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:55 devstack sudo[152524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:55 devstack sudo[152361]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" returned: 0 in 5.375s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce794e-5a1c-4ea1-b841-21c302ad2e8f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:55 devstack sudo[152547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab Jun 20 00:15:55 devstack sudo[152547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-3b34cd85-abed-45a7-af4b-35e72659ef87-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-3b34cd85-abed-45a7-af4b-35e72659ef87-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-quobyte-3b34cd85-abed-45a7-af4b-35e72659ef87" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:55 devstack sudo[152524]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.999s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:55 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Deleted volume successfully. Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-3b34cd85-abed-45a7-af4b-35e72659ef87" acquired by "delete_volume" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acf179f-932f-41d6-a758-e0b4de5fffa8]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:55 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-88c0ac5e-499f-45e2-9977-934e449fcbb7 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-158d5d3a-d50c-4a33-8eca-c749ee89056c-delete_volume" released by "delete_volume" :: held 4.824s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:56 devstack sudo[152560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 Jun 20 00:15:56 devstack sudo[152560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:56 devstack sudo[152547]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab" returned: 0 in 1.034s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:56 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:15:56 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Converted 1024.00 MB image at 190.46 MB/s Jun 20 00:15:56 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 is being set with open permissions: ugo+rw Jun 20 00:15:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:56 devstack sudo[152589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 Jun 20 00:15:56 devstack sudo[152589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:56 devstack sudo[152560]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87" returned: 0 in 0.756s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:56 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:56 devstack sudo[152594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87 Jun 20 00:15:56 devstack sudo[152594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:57 devstack sudo[152589]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" returned: 0 in 0.661s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" released by "_copy_volume_from_snapshot" :: held 8.883s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-f80ae32d-4560-4877-b8e1-d5101fa9c466-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" released by "_create_volume_from_snapshot" :: held 8.915s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.946s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.317s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-quobyte-e3f5ea67-c2d8-4101-9b02-e8def032e36e-9f6465a7-0aaf-469e-bce4-89ffdd46e681" by "_create_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-e3f5ea67-c2d8-4101-9b02-e8def032e36e-9f6465a7-0aaf-469e-bce4-89ffdd46e681" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Creating volume 9f6465a7-0aaf-469e-bce4-89ffdd46e681 from snapshot e3f5ea67-c2d8-4101-9b02-e8def032e36e {{(pid=93391) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Selected osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22 as target Quobyte volume. {{(pid=93391) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-quobyte-9f6465a7-0aaf-469e-bce4-89ffdd46e681" by "_copy_volume_from_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5353e935-409a-474a-8357-761c3429a0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932', 'volume_size': 1, 'snapshot_id': 'f80ae32d-4560-4877-b8e1-d5101fa9c466'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9922c4e1-43fb-4bd7-a170-f609dfe3e848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:15:57 devstack sudo[152594]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-9f6465a7-0aaf-469e-bce4-89ffdd46e681" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] snapshot: e3f5ea67-c2d8-4101-9b02-e8def032e36e, volume: 9f6465a7-0aaf-469e-bce4-89ffdd46e681, {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-3b34cd85-abed-45a7-af4b-35e72659ef87" returned: 0 in 0.666s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:57 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Volume volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 (e8b1d954-b0c8-47e0-94e1-4a1970ac3932): created successfully Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9922c4e1-43fb-4bd7-a170-f609dfe3e848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Flow 'volume_create_manager' (a6007e6b-c9de-4dbb-92af-a5057fc1c405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-3b34cd85-abed-45a7-af4b-35e72659ef87" released by "delete_volume" :: held 1.477s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59beb399-1a6a-478b-a8b7-b5c6284b8bdf]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:57 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-54c0f16d-cd9b-43e6-9823-9e4c4180b512 tempest-VolumeDependencyTests-523593572 None] Created volume successfully. Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created reservations ['9d3fdfd8-06b5-4b70-8956-7c813e86c1ac', '6cbcf4e3-7e54-45bf-a197-9f37bee58657', '37f33651-cffa-495d-8825-9fab630f3ab7', '908c9a2e-5ae0-4f99-9c4e-77ccb3d80c6a'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:15:57 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:57 devstack sudo[152619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e Jun 20 00:15:57 devstack sudo[152619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:57 devstack sudo[152624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:15:57 devstack sudo[152624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-f80ae32d-4560-4877-b8e1-d5101fa9c466-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-f80ae32d-4560-4877-b8e1-d5101fa9c466-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-quobyte-da25c71c-8d39-49cd-9922-7a6ab79550ab" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-e1d45cc7-aa09-4c0c-824a-6e02f320f883-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-da25c71c-8d39-49cd-9922-7a6ab79550ab" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-quobyte-f80ae32d-4560-4877-b8e1-d5101fa9c466" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-e1d45cc7-aa09-4c0c-824a-6e02f320f883-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-quobyte-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-f80ae32d-4560-4877-b8e1-d5101fa9c466" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Deleting offline snapshot f80ae32d-4560-4877-b8e1-d5101fa9c466 of volume da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] snapshot_file for this snap is: volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-quobyte-e1d45cc7-aa09-4c0c-824a-6e02f320f883" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c629b31c-c323-4a67-ba05-d4093396ff75]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-e1d45cc7-aa09-4c0c-824a-6e02f320f883" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Deleting offline snapshot e1d45cc7-aa09-4c0c-824a-6e02f320f883 of volume e8b4b677-3bf8-4855-9fd4-21e711ec97e3 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] snapshot_file for this snap is: volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:15:58 devstack sudo[152619]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e" returned: 0 in 0.859s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Creating direct copy from snapshot {{(pid=93391) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 20 00:15:58 devstack sudo[152624]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a972cbf0-db37-4019-8d88-3b02a8f2b282]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b23867a-dc1a-4ba4-802f-6e0aa10a080f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.791s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:15:58 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Deleted volume successfully. Jun 20 00:15:58 devstack sudo[152651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 Jun 20 00:15:58 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-836c0bb5-fbde-4794-b586-6156dbe3ac78 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-3b34cd85-abed-45a7-af4b-35e72659ef87-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:15:58 devstack sudo[152651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:58 devstack sudo[152655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 Jun 20 00:15:58 devstack sudo[152655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:58 devstack sudo[152656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea Jun 20 00:15:58 devstack sudo[152656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:59 devstack sudo[152651]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466" returned: 0 in 0.834s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da25c71c-8d39-49cd-9922-7a6ab79550ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[363cd05f-ea12-4c2a-822c-b90f42f4fcde]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:59 devstack sudo[152655]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:59 devstack sudo[152656]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883" returned: 0 in 0.819s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" returned: 0 in 0.831s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG cinder.utils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Path /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 not found in is_blk_device check {{(pid=93391) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37fa60d-05be-4be4-b95d-343f4dd92e2f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:59 devstack sudo[152694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 Jun 20 00:15:59 devstack sudo[152694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:59 devstack sudo[152693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab Jun 20 00:15:59 devstack sudo[152693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:59 devstack sudo[152696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 Jun 20 00:15:59 devstack sudo[152696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:15:59 devstack sudo[152693]: pam_unix(sudo:session): session closed for user root Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab" returned: 0 in 0.816s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:15:59 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:15:59 devstack sudo[152735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 Jun 20 00:15:59 devstack sudo[152735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:00 devstack sudo[152696]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" returned: 0 in 0.835s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:00 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:00 devstack sudo[152745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 Jun 20 00:16:00 devstack sudo[152745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:01 devstack sudo[152735]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466" returned: 0 in 1.876s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:01 devstack sudo[152814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466 Jun 20 00:16:01 devstack sudo[152745]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:01 devstack sudo[152814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883" returned: 0 in 1.879s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:01 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:01 devstack sudo[152817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883 Jun 20 00:16:01 devstack sudo[152817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:03 devstack sudo[152814]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab.f80ae32d-4560-4877-b8e1-d5101fa9c466" returned: 0 in 1.984s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:03 devstack sudo[152817]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:03 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3.e1d45cc7-aa09-4c0c-824a-6e02f320f883" returned: 0 in 1.976s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-f80ae32d-4560-4877-b8e1-d5101fa9c466" released by "_delete_snapshot" :: held 5.708s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:03 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-da25c71c-8d39-49cd-9922-7a6ab79550ab" released by "delete_snapshot" :: held 5.816s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-e1d45cc7-aa09-4c0c-824a-6e02f320f883" released by "_delete_snapshot" :: held 5.731s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" released by "delete_snapshot" :: held 5.819s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Created reservations ['ecd1ca22-b367-4ec4-956d-a504f1731059', 'da23c1c2-6a92-4b5f-b5b8-80d4a82d4319', 'c7e612bb-e550-4cf5-91f8-6718a09cef36', 'b6e3b9ab-e41e-4f85-9f1f-8f10ea4ddaee'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Created reservations ['e4376ddc-8968-42ac-84a4-b015611e193f', '11a36048-8846-4117-8305-04cd9689c6c9', '6324ab46-dbea-4391-9b55-66a459b9c9ea', '4f85b6fe-f164-48b7-9125-6ea9d69b9243'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:16:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Delete snapshot completed successfully. Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-6f091ab5-208d-4628-aaba-c229c9394511 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-f80ae32d-4560-4877-b8e1-d5101fa9c466-delete_snapshot" released by "delete_snapshot" :: held 6.337s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:04 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Delete snapshot completed successfully. Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-cbd7ffb1-8e97-4b81-8bc9-301bfb2baf9e tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-e1d45cc7-aa09-4c0c-824a-6e02f320f883-delete_snapshot" released by "delete_snapshot" :: held 6.334s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-da25c71c-8d39-49cd-9922-7a6ab79550ab-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-da25c71c-8d39-49cd-9922-7a6ab79550ab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:04 devstack sudo[152694]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681" returned: 0 in 5.606s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-quobyte-da25c71c-8d39-49cd-9922-7a6ab79550ab" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-e8b4b677-3bf8-4855-9fd4-21e711ec97e3-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e40a8d-4b0a-4fe0-a491-5a5aaf81bc8c]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-da25c71c-8d39-49cd-9922-7a6ab79550ab" acquired by "delete_volume" :: waited 0.045s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-e8b4b677-3bf8-4855-9fd4-21e711ec97e3-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17bf7a0-6be4-4e18-b075-9c7faa73a97e]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "cinder-quobyte-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" acquired by "delete_volume" :: waited 0.018s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:04 devstack sudo[152909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea Jun 20 00:16:04 devstack sudo[152909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bf3258-6e56-491d-b284-b9ae9a45794a]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:16:04 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:05 devstack sudo[152913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab Jun 20 00:16:05 devstack sudo[152913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:05 devstack sudo[152918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 Jun 20 00:16:05 devstack sudo[152918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:05 devstack sudo[152913]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab" returned: 0 in 0.774s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:05 devstack sudo[152948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab Jun 20 00:16:05 devstack sudo[152948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:05 devstack sudo[152918]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" returned: 0 in 0.785s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:05 devstack sudo[152909]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" returned: 0 in 0.991s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:05 devstack cinder-volume[93391]: DEBUG cinder.image.image_utils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Image conversion details: src /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 {{(pid=93391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 20 00:16:05 devstack cinder-volume[93391]: INFO cinder.image.image_utils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Converted 1024.00 MB image at 182.62 MB/s Jun 20 00:16:05 devstack cinder-volume[93391]: WARNING cinder.volume.drivers.remotefs [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 is being set with open permissions: ugo+rw Jun 20 00:16:05 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:05 devstack sudo[152954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3 Jun 20 00:16:05 devstack sudo[152954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:05 devstack sudo[152959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 Jun 20 00:16:05 devstack sudo[152959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:06 devstack sudo[152948]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-da25c71c-8d39-49cd-9922-7a6ab79550ab" returned: 0 in 0.711s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-da25c71c-8d39-49cd-9922-7a6ab79550ab" released by "delete_volume" :: held 1.569s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Created reservations ['18ba5be9-d237-40d0-aa57-a60296d33a67', '5fd84efa-2fb9-4083-8b90-e8be24b00b98', '4760627c-102b-4744-8ee6-6c30c383c9e2', '634b1b61-ab26-40c8-ad03-57c425dffb64'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:16:06 devstack sudo[152954]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" returned: 0 in 0.745s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-quobyte-e8b4b677-3bf8-4855-9fd4-21e711ec97e3" released by "delete_volume" :: held 1.596s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:06 devstack sudo[152959]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681" returned: 0 in 0.740s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-9f6465a7-0aaf-469e-bce4-89ffdd46e681" released by "_copy_volume_from_snapshot" :: held 9.176s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-e3f5ea67-c2d8-4101-9b02-e8def032e36e-9f6465a7-0aaf-469e-bce4-89ffdd46e681" released by "_create_volume_from_snapshot" :: held 9.225s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.247s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:06 devstack sudo[152987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:16:06 devstack sudo[152987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2879efad-3688-477d-ab3b-2cb908889999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681', 'volume_size': 1, 'snapshot_id': 'e3f5ea67-c2d8-4101-9b02-e8def032e36e'}' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf8939d-adb7-487a-a2a7-867afafe96c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Created reservations ['447825ad-20f3-4e46-b852-9bcffc091f89', '687ce5f7-55d0-41d7-b861-c1fe5e7c5900', '6ed58703-ddb3-40bf-ad9a-2fbc79a4bed5', '01227b4d-092e-4a08-94e1-2dbfd94a70c1'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:16:06 devstack cinder-volume[93391]: INFO cinder.volume.flows.manager.create_volume [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Volume volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 (9f6465a7-0aaf-469e-bce4-89ffdd46e681): created successfully Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf8939d-adb7-487a-a2a7-867afafe96c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93391) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Flow 'volume_create_manager' (56be0866-cb23-48c0-bfe5-15c9cad72670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93391) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 20 00:16:06 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-18b0c65c-da0d-413b-af5e-6d6ea57d6c88 tempest-SnapshotDependencyTests-833580803 None] Created volume successfully. Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:06 devstack sudo[152993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:16:06 devstack sudo[152993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-e3f5ea67-c2d8-4101-9b02-e8def032e36e-delete_snapshot" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-e3f5ea67-c2d8-4101-9b02-e8def032e36e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-quobyte-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" by "delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-quobyte-e3f5ea67-c2d8-4101-9b02-e8def032e36e" by "_delete_snapshot" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-e3f5ea67-c2d8-4101-9b02-e8def032e36e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Deleting offline snapshot e3f5ea67-c2d8-4101-9b02-e8def032e36e of volume eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] snapshot_file for this snap is: volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e {{(pid=93391) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34113dd-2b9b-4a9a-a0ba-2aeeb9700b81]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:16:06 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-e8b1d954-b0c8-47e0-94e1-4a1970ac3932-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-e8b1d954-b0c8-47e0-94e1-4a1970ac3932-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "cinder-quobyte-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" acquired by "delete_volume" :: waited 0.034s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:07 devstack sudo[153002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e Jun 20 00:16:07 devstack sudo[153002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a15ecc-989d-4fe1-b970-77a20c9fc037]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:07 devstack sudo[153012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 Jun 20 00:16:07 devstack sudo[153012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:07 devstack sudo[152993]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:07 devstack sudo[152987]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.884s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 1.053s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:16:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Deleted volume successfully. Jun 20 00:16:07 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Deleted volume successfully. Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ac4cdd2a-83c2-4b1f-a999-260df46f8505 tempest-CreateVolumesFromSnapshotTest-32890655 None] Lock "cinder-e8b4b677-3bf8-4855-9fd4-21e711ec97e3-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-7daf1798-f010-475d-b7b9-b40dba60aca1 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-da25c71c-8d39-49cd-9922-7a6ab79550ab-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:07 devstack sudo[153002]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e" returned: 0 in 1.030s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:07 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.remotefs [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93391) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 20 00:16:08 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ae8c49-48c9-4611-8d6a-9e5b2bbe40bf]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:16:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:08 devstack sudo[153012]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" returned: 0 in 0.938s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:08 devstack sudo[153046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea Jun 20 00:16:08 devstack sudo[153046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:08 devstack sudo[153050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932 Jun 20 00:16:08 devstack sudo[153050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:08 devstack sudo[153050]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" returned: 0 in 0.765s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:08 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-quobyte-e8b1d954-b0c8-47e0-94e1-4a1970ac3932" released by "delete_volume" :: held 1.771s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:08 devstack sudo[153046]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" returned: 0 in 0.923s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:08 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:09 devstack sudo[153082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e Jun 20 00:16:09 devstack sudo[153082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Created reservations ['cd272d84-09ab-4d3e-ab88-b817090cf11a', '1a7798d6-e836-44e2-9364-c91b71fd95a2', '2402d7e8-c22f-43db-8fb5-73c6280eb30d', 'd6d79892-1206-4799-8b78-d607b11e9ccb'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:09 devstack sudo[153091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:16:09 devstack sudo[153091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:09 devstack sudo[153082]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e" returned: 0 in 0.799s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:09 devstack sudo[153091]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.693s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:16:09 devstack sudo[153115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e Jun 20 00:16:09 devstack sudo[153115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:09 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Deleted volume successfully. Jun 20 00:16:09 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-fcb414ca-d747-4159-8879-b51194d45993 tempest-VolumeDependencyTests-523593572 None] Lock "cinder-e8b1d954-b0c8-47e0-94e1-4a1970ac3932-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:10 devstack sudo[153115]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:10 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea.e3f5ea67-c2d8-4101-9b02-e8def032e36e" returned: 0 in 0.689s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-e3f5ea67-c2d8-4101-9b02-e8def032e36e" released by "_delete_snapshot" :: held 3.593s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" released by "delete_snapshot" :: held 3.629s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:10 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Created reservations ['602ad3d4-2472-4144-9a1d-ae9bac252adf', '696ce0d5-720f-44f6-bca5-60099a3d5ffc', '865d8d47-b5f2-49bb-8cfe-91d0cc030051', '4f1790b2-21a4-4304-b2ec-379ca616d1ae'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:16:10 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Delete snapshot completed successfully. Jun 20 00:16:10 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-bec89cd2-f056-4f5e-8bd5-694e9604bc74 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-e3f5ea67-c2d8-4101-9b02-e8def032e36e-delete_snapshot" released by "delete_snapshot" :: held 3.811s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-eafe13f4-cc9a-4488-bc22-0f1bdada91ea-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-eafe13f4-cc9a-4488-bc22-0f1bdada91ea-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-quobyte-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:11 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" acquired by "delete_volume" :: waited 0.015s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:11 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b42480-65bf-4b7c-ad58-04cab27a02f3]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:16:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:11 devstack sudo[153160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea Jun 20 00:16:11 devstack sudo[153160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:11 devstack sudo[153160]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" returned: 0 in 0.747s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:11 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:11 devstack sudo[153191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea Jun 20 00:16:11 devstack sudo[153191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:12 devstack sudo[153191]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" returned: 0 in 0.631s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-eafe13f4-cc9a-4488-bc22-0f1bdada91ea" released by "delete_volume" :: held 1.432s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Created reservations ['1e6d81ee-9dfd-45d8-ac2a-fcd53ef0fa0a', '5eb181c8-6b5e-403c-bdb2-3b81acfd21de', '538ac660-4a4f-4aca-9e3c-db44835808bf', '240c69f6-7d7d-42f8-9b8b-d05affa014bc'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:16:12 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:12 devstack sudo[153215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:16:12 devstack sudo[153215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-9f6465a7-0aaf-469e-bce4-89ffdd46e681-delete_volume" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:13 devstack sudo[153215]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-9f6465a7-0aaf-469e-bce4-89ffdd46e681-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.648s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:16:13 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Deleted volume successfully. Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ea266749-166e-4cb5-855f-1540388f7b2c tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-eafe13f4-cc9a-4488-bc22-0f1bdada91ea-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "cinder-quobyte-9f6465a7-0aaf-469e-bce4-89ffdd46e681" by "delete_volume" {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-9f6465a7-0aaf-469e-bce4-89ffdd46e681" acquired by "delete_volume" :: waited 0.014s {{(pid=93391) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77ea16c-6590-4cd2-a212-62fb3dfadb0f]: (4, 'qcow2') {{(pid=94670) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 20 00:16:13 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:13 devstack sudo[153242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 Jun 20 00:16:13 devstack sudo[153242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:14 devstack sudo[153242]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681" returned: 0 in 0.744s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:14 devstack sudo[153268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681 Jun 20 00:16:14 devstack sudo[153268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:14 devstack sudo[153268]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df/volume-9f6465a7-0aaf-469e-bce4-89ffdd46e681" returned: 0 in 0.624s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-quobyte-9f6465a7-0aaf-469e-bce4-89ffdd46e681" released by "delete_volume" :: held 1.409s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG cinder.quota [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Created reservations ['847335f0-e72a-4568-9795-c1c97c54e708', '7e70582b-50c4-445b-b6a9-a25cd07aaf20', '72ec7b58-612b-41aa-afab-ceb9a54361fe', '6283fb5a-a58d-41b0-8cdc-5882f3f519ac'] {{(pid=93391) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:16:14 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:14 devstack sudo[153294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:16:14 devstack sudo[153294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:15 devstack sudo[153294]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:15 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.630s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:15 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:16:15 devstack cinder-volume[93391]: INFO cinder.volume.manager [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Deleted volume successfully. Jun 20 00:16:15 devstack cinder-volume[93391]: DEBUG cinder.coordination [None req-ceeb7784-2dd9-4215-8530-776b1e4d99a6 tempest-SnapshotDependencyTests-833580803 None] Lock "cinder-9f6465a7-0aaf-469e-bce4-89ffdd46e681-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=93391) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 20 00:16:24 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:UPDATE=120,cinder:SELECT=76,cinder:DELETE=7,cinder:INSERT=28 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:16:25 devstack cinder-volume[93391]: DEBUG dbcounter [-] [93391] Writing DB stats cinder:SELECT=88,cinder:INSERT=31,cinder:UPDATE=109,cinder:DELETE=12 {{(pid=93391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22': None} {{(pid=93391) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG cinder.volume.drivers.quobyte [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3c865820-9c6e-433f-b567-22924cf70d22'] {{(pid=93391) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.lockutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93391) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 20 00:16:28 devstack sudo[153736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df Jun 20 00:16:28 devstack sudo[153736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 20 00:16:28 devstack sudo[153736]: pam_unix(sudo:session): session closed for user root Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG oslo_concurrency.processutils [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4e1b1e6bc4b6c2a97fd13095aa4681df" returned: 0 in 0.633s {{(pid=93391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG cinder.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Notifying Schedulers of capabilities ... {{(pid=93391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG oslo_service.periodic_task [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] Running periodic task VolumeManager._thread_info {{(pid=93391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread count: 29 {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 20 00:16:28 devstack cinder-volume[93391]: DEBUG cinder.volume.manager [None req-a3a8ba3c-4441-49fe-bd24-49878909556b None None] thread info: [<_MainThread(MainThread, started 139686206337152)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}